Max level shown:
12025-01-15T00:45:01.492ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
22025-01-15T00:45:01.492ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
32025-01-15T00:45:01.493ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
42025-01-15T00:45:01.493ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
52025-01-15T00:45:01.495ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62025-01-15T00:45:01.498ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
72025-01-15T00:45:01.498ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
82025-01-15T00:45:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
92025-01-15T00:45:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102025-01-15T00:45:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112025-01-15T00:45:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122025-01-15T00:45:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132025-01-15T00:45:02.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142025-01-15T00:45:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
152025-01-15T00:45:02.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
162025-01-15T00:45:02.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
172025-01-15T00:45:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
182025-01-15T00:45:02.609ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
192025-01-15T00:45:02.609ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.672948ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
202025-01-15T00:45:02.639ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
212025-01-15T00:45:02.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
222025-01-15T00:45:02.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.996223ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
232025-01-15T00:45:03.498ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
242025-01-15T00:45:03.499ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
252025-01-15T00:45:03.500ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
262025-01-15T00:45:03.500ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
272025-01-15T00:45:03.502ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
282025-01-15T00:45:03.505ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
292025-01-15T00:45:03.505ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
302025-01-15T00:45:05.506ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
312025-01-15T00:45:05.506ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
322025-01-15T00:45:05.507ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
332025-01-15T00:45:05.508ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
342025-01-15T00:45:05.509ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
352025-01-15T00:45:05.512ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
362025-01-15T00:45:05.512ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
372025-01-15T00:45:07.513ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
382025-01-15T00:45:07.513ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
392025-01-15T00:45:07.515ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
402025-01-15T00:45:07.515ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
412025-01-15T00:45:07.517ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
422025-01-15T00:45:07.520ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
432025-01-15T00:45:07.520ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
442025-01-15T00:45:09.521ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
452025-01-15T00:45:09.522ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
462025-01-15T00:45:09.523ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
472025-01-15T00:45:09.524ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
482025-01-15T00:45:09.526ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
492025-01-15T00:45:09.528ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
502025-01-15T00:45:09.528ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
512025-01-15T00:45:11.529ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
522025-01-15T00:45:11.530ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
532025-01-15T00:45:11.531ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
542025-01-15T00:45:11.532ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
552025-01-15T00:45:11.534ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
562025-01-15T00:45:11.536ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
572025-01-15T00:45:11.536ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
582025-01-15T00:45:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
592025-01-15T00:45:12.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
602025-01-15T00:45:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
612025-01-15T00:45:12.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
622025-01-15T00:45:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
632025-01-15T00:45:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
642025-01-15T00:45:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
652025-01-15T00:45:12.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
662025-01-15T00:45:12.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
672025-01-15T00:45:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
682025-01-15T00:45:12.609ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
692025-01-15T00:45:12.609ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.619498ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
702025-01-15T00:45:12.643ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
712025-01-15T00:45:12.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
722025-01-15T00:45:12.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.697705ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
732025-01-15T00:45:13.537ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
742025-01-15T00:45:13.537ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
752025-01-15T00:45:13.539ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
762025-01-15T00:45:13.539ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
772025-01-15T00:45:13.541ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
782025-01-15T00:45:13.544ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
792025-01-15T00:45:13.544ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
802025-01-15T00:45:15.545ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
812025-01-15T00:45:15.545ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
822025-01-15T00:45:15.547ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
832025-01-15T00:45:15.547ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
842025-01-15T00:45:15.548ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
852025-01-15T00:45:15.551ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
862025-01-15T00:45:15.551ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
872025-01-15T00:45:17.551ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
882025-01-15T00:45:17.552ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
892025-01-15T00:45:17.554ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
902025-01-15T00:45:17.554ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
912025-01-15T00:45:17.556ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
922025-01-15T00:45:17.558ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
932025-01-15T00:45:17.558ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
942025-01-15T00:45:19.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34487 req_id = de39cd96-796a-46bc-998a-624d0c399bc8 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
952025-01-15T00:45:19.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34487 req_id = de39cd96-796a-46bc-998a-624d0c399bc8 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
962025-01-15T00:45:19.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3161 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34487 req_id = de39cd96-796a-46bc-998a-624d0c399bc8 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
972025-01-15T00:45:19.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34487 req_id = fb74d3cf-8f84-403c-a21a-a21dc2f31b13 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI3MWNiYzljNS1lZGU5LTRjZGQtYjAyZC05ZDRlNDU3OGJiZTkifX0%3D
982025-01-15T00:45:19.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34487 req_id = fb74d3cf-8f84-403c-a21a-a21dc2f31b13 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI3MWNiYzljNS1lZGU5LTRjZGQtYjAyZC05ZDRlNDU3OGJiZTkifX0%3D
992025-01-15T00:45:19.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3176 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34487 req_id = fb74d3cf-8f84-403c-a21a-a21dc2f31b13 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI3MWNiYzljNS1lZGU5LTRjZGQtYjAyZC05ZDRlNDU3OGJiZTkifX0%3D
1002025-01-15T00:45:19.560ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1012025-01-15T00:45:19.560ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1022025-01-15T00:45:19.562ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1032025-01-15T00:45:19.562ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1042025-01-15T00:45:19.564ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1052025-01-15T00:45:19.566ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
1062025-01-15T00:45:19.566ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
1072025-01-15T00:45:21.568ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1082025-01-15T00:45:21.568ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1092025-01-15T00:45:21.569ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1102025-01-15T00:45:21.569ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1112025-01-15T00:45:21.571ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1122025-01-15T00:45:21.573ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
1132025-01-15T00:45:21.573ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
1142025-01-15T00:45:22.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
1152025-01-15T00:45:22.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
1162025-01-15T00:45:22.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1172025-01-15T00:45:22.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1182025-01-15T00:45:22.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
1192025-01-15T00:45:22.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1202025-01-15T00:45:22.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
1212025-01-15T00:45:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1222025-01-15T00:45:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1232025-01-15T00:45:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1242025-01-15T00:45:22.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
1252025-01-15T00:45:22.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
1262025-01-15T00:45:22.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
1272025-01-15T00:45:22.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1282025-01-15T00:45:22.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1292025-01-15T00:45:22.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1302025-01-15T00:45:22.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 2 reason = Timeout
1312025-01-15T00:45:22.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
1322025-01-15T00:45:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1332025-01-15T00:45:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1342025-01-15T00:45:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1352025-01-15T00:45:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
1362025-01-15T00:45:22.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1372025-01-15T00:45:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 942, tv_nsec: 935755089 } })
1382025-01-15T00:45:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
1392025-01-15T00:45:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 942, tv_nsec: 936231218 } })
1402025-01-15T00:45:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
1412025-01-15T00:45:22.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1422025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1432025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
1442025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1452025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1462025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
1472025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1482025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
1492025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
1502025-01-15T00:45:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1512025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1522025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1532025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
1542025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1552025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1562025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
1572025-01-15T00:45:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1582025-01-15T00:45:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1592025-01-15T00:45:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1602025-01-15T00:45:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1612025-01-15T00:45:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1622025-01-15T00:45:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1632025-01-15T00:45:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1642025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
1652025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1662025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
1672025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1682025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
1692025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1702025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
1712025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1722025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
1732025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1742025-01-15T00:45:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1752025-01-15T00:45:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1762025-01-15T00:45:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1772025-01-15T00:45:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1782025-01-15T00:45:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1792025-01-15T00:45:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1802025-01-15T00:45:22.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1812025-01-15T00:45:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1822025-01-15T00:45:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
1832025-01-15T00:45:22.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1842025-01-15T00:45:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
1852025-01-15T00:45:22.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1862025-01-15T00:45:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1872025-01-15T00:45:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1882025-01-15T00:45:22.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1892025-01-15T00:45:22.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1902025-01-15T00:45:22.615ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1912025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1922025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1932025-01-15T00:45:22.615ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
1942025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 12.510881ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
1952025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1962025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
1972025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1982025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1992025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
2002025-01-15T00:45:22.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
2012025-01-15T00:45:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2022025-01-15T00:45:22.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.421661ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
2032025-01-15T00:45:22.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2042025-01-15T00:45:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2052025-01-15T00:45:22.620ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
2062025-01-15T00:45:22.620ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 15.541249ms iteration = 3 status = {"error":"rack not yet initialized: c52fc7fb-8746-40c6-805b-707ae8abbd97"}
2072025-01-15T00:45:22.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2082025-01-15T00:45:22.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2092025-01-15T00:45:22.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2102025-01-15T00:45:22.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2112025-01-15T00:45:22.626ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 18.432315ms iteration = 2 status = {}
2122025-01-15T00:45:22.631ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 28.658592ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2132025-01-15T00:45:22.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2142025-01-15T00:45:22.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2152025-01-15T00:45:22.650ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2162025-01-15T00:45:22.652ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
2172025-01-15T00:45:22.652ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2182025-01-15T00:45:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2192025-01-15T00:45:22.652ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2202025-01-15T00:45:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2212025-01-15T00:45:22.652ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa7224ef-47ad-4e70-ab29-f4bd3088a53b", "content-length": "26", "date": "Wed, 15 Jan 2025 00:45:22 GMT"} })
2222025-01-15T00:45:22.652ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2232025-01-15T00:45:22.653ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
2242025-01-15T00:45:22.653ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2252025-01-15T00:45:22.653ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaa97a5c-037b-4217-893c-d03cdc0e0567", "content-length": "26", "date": "Wed, 15 Jan 2025 00:45:22 GMT"} })
2262025-01-15T00:45:22.653ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2272025-01-15T00:45:22.653ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2282025-01-15T00:45:22.653ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2292025-01-15T00:45:22.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2302025-01-15T00:45:22.655ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2312025-01-15T00:45:22.655ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2322025-01-15T00:45:22.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2332025-01-15T00:45:22.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 47.29516ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2342025-01-15T00:45:22.658ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 48.282529ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
2352025-01-15T00:45:22.662ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2362025-01-15T00:45:22.662ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2372025-01-15T00:45:22.662ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2382025-01-15T00:45:22.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2392025-01-15T00:45:22.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2402025-01-15T00:45:22.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2412025-01-15T00:45:22.666ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2422025-01-15T00:45:22.666ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.953955ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2432025-01-15T00:45:22.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2442025-01-15T00:45:22.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2452025-01-15T00:45:22.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.853602ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2462025-01-15T00:45:22.685ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2472025-01-15T00:45:22.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2482025-01-15T00:45:22.687ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2492025-01-15T00:45:22.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
2502025-01-15T00:45:22.689ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
2512025-01-15T00:45:22.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
2522025-01-15T00:45:22.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.706902ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2532025-01-15T00:45:22.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.864288ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
2542025-01-15T00:45:22.703ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2552025-01-15T00:45:22.703ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2562025-01-15T00:45:22.703ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.419056ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2572025-01-15T00:45:22.714ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 110.026797ms iteration = 2 status = {}
2582025-01-15T00:45:22.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2592025-01-15T00:45:22.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2602025-01-15T00:45:22.724ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
2612025-01-15T00:45:22.724ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fca6ac63-2b81-469c-b345-37c2194ee394", "content-length": "1", "date": "Wed, 15 Jan 2025 00:45:22 GMT"} })
2622025-01-15T00:45:22.724ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 122.211392ms iteration = 2 status = {}
2632025-01-15T00:45:22.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
2642025-01-15T00:45:22.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
2652025-01-15T00:45:22.730ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
2662025-01-15T00:45:22.730ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 125.708559ms iteration = 2 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
2672025-01-15T00:45:22.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2682025-01-15T00:45:22.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2692025-01-15T00:45:22.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2702025-01-15T00:45:22.736ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2712025-01-15T00:45:22.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2722025-01-15T00:45:22.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2732025-01-15T00:45:22.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2742025-01-15T00:45:22.739ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 137.010917ms iteration = 2 status = null
2752025-01-15T00:45:22.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2762025-01-15T00:45:22.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2772025-01-15T00:45:22.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2782025-01-15T00:45:22.742ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 135.019159ms iteration = 2 status = {}
2792025-01-15T00:45:22.759ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
2802025-01-15T00:45:22.759ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 154.772658ms iteration = 2 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
2812025-01-15T00:45:23.574ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2822025-01-15T00:45:23.575ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2832025-01-15T00:45:23.577ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2842025-01-15T00:45:23.577ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2852025-01-15T00:45:23.578ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2862025-01-15T00:45:23.581ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
2872025-01-15T00:45:23.581ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
2882025-01-15T00:45:25.582ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2892025-01-15T00:45:25.582ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2902025-01-15T00:45:25.585ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2912025-01-15T00:45:25.585ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2922025-01-15T00:45:25.586ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2932025-01-15T00:45:25.589ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
2942025-01-15T00:45:25.589ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
2952025-01-15T00:45:27.590ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2962025-01-15T00:45:27.590ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2972025-01-15T00:45:27.595ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2982025-01-15T00:45:27.595ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2992025-01-15T00:45:27.597ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3002025-01-15T00:45:27.600ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
3012025-01-15T00:45:27.600ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
3022025-01-15T00:45:29.600ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3032025-01-15T00:45:29.600ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3042025-01-15T00:45:29.602ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3052025-01-15T00:45:29.602ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3062025-01-15T00:45:29.604ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3072025-01-15T00:45:29.607ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
3082025-01-15T00:45:29.607ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
3092025-01-15T00:45:31.608ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3102025-01-15T00:45:31.608ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3112025-01-15T00:45:31.610ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3122025-01-15T00:45:31.610ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3132025-01-15T00:45:31.612ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3142025-01-15T00:45:31.614ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
3152025-01-15T00:45:31.614ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
3162025-01-15T00:45:32.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
3172025-01-15T00:45:32.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3182025-01-15T00:45:32.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3192025-01-15T00:45:32.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3202025-01-15T00:45:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
3212025-01-15T00:45:32.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3222025-01-15T00:45:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3232025-01-15T00:45:32.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
3242025-01-15T00:45:32.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3252025-01-15T00:45:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3262025-01-15T00:45:32.609ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
3272025-01-15T00:45:32.609ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.424914ms iteration = 5 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
3282025-01-15T00:45:32.641ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
3292025-01-15T00:45:32.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
3302025-01-15T00:45:32.643ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.614765ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
3312025-01-15T00:45:33.616ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3322025-01-15T00:45:33.616ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3332025-01-15T00:45:33.618ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3342025-01-15T00:45:33.618ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3352025-01-15T00:45:33.620ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3362025-01-15T00:45:33.623ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
3372025-01-15T00:45:33.623ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
3382025-01-15T00:45:35.624ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3392025-01-15T00:45:35.624ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3402025-01-15T00:45:35.626ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3412025-01-15T00:45:35.626ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3422025-01-15T00:45:35.628ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3432025-01-15T00:45:35.630ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
3442025-01-15T00:45:35.630ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
3452025-01-15T00:45:36.810ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:43040
3462025-01-15T00:45:36.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43040 req_id = 1b9632ab-60cd-4551-b5dc-621e7af586e1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3472025-01-15T00:45:36.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43040 req_id = 1b9632ab-60cd-4551-b5dc-621e7af586e1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3482025-01-15T00:45:36.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10564 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43040 req_id = 1b9632ab-60cd-4551-b5dc-621e7af586e1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3492025-01-15T00:45:36.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43040 req_id = 5fb177ab-ee5e-4f55-841c-7f6d095e875d roles = RoleSet { roles: {} } uri = /sled-agents/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3502025-01-15T00:45:36.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43040 req_id = 5fb177ab-ee5e-4f55-841c-7f6d095e875d resource = Database result = Ok(()) uri = /sled-agents/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3512025-01-15T00:45:36.834ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9" error_message_internal = not found: sled with id "71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 5461 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:43040 req_id = 5fb177ab-ee5e-4f55-841c-7f6d095e875d response_code = 404 uri = /sled-agents/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3522025-01-15T00:45:37.185ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:57 sled_uuid = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3532025-01-15T00:45:37.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94463 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:43040 req_id = 1935ad7a-1bcc-4957-882a-e5cefc655728 response_code = 204 uri = /sled-agents/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
3542025-01-15T00:45:37.275ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
3552025-01-15T00:45:37.275ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
3562025-01-15T00:45:37.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
3572025-01-15T00:45:37.277ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3582025-01-15T00:45:37.279ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
3592025-01-15T00:45:37.279ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
3602025-01-15T00:45:37.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
3612025-01-15T00:45:37.289ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(7067938a-7aa8-4445-942b-a5fed60936ff, 0), (acb9f6d1-0c27-4d32-bb66-bea18f560971, 0), (87544e3f-558e-49c4-a575-93fad3f8d8fd, 0)]
3622025-01-15T00:45:37.289ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 957, tv_nsec: 619402206 } })
3632025-01-15T00:45:37.320ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
3642025-01-15T00:45:37.320ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
3652025-01-15T00:45:37.320ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
3662025-01-15T00:45:37.320ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "769d745f-33c7-48d2-90a9-a4fc8d15b14c", "content-length": "476", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3672025-01-15T00:45:37.320ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
3682025-01-15T00:45:37.321ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bea25ae1-4528-44ef-b61b-ca70ed733501", "content-length": "734", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3692025-01-15T00:45:37.321ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
3702025-01-15T00:45:37.321ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "40b09c0f-a214-43e5-bfb0-b714472c513e", "content-length": "111", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3712025-01-15T00:45:37.321ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
3722025-01-15T00:45:37.321ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "94b39d6b-c7ba-472a-8dce-7fc9a4747ba9", "content-length": "111", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3732025-01-15T00:45:37.321ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
3742025-01-15T00:45:37.321ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e97529-67ab-4d24-9684-287c8f0920c6", "content-length": "167", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3752025-01-15T00:45:37.321ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
3762025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc4a997d-50bb-49e7-912b-3e68ee79b0c8", "content-length": "167", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3772025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
3782025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "88c8ac4a-ad9d-4454-9c87-e210ec7f9d76", "content-length": "175", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3792025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
3802025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "775cb335-b48a-40ef-8d08-328c691ff9aa", "content-length": "175", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3812025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
3822025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "01c74ff8-44ba-49f2-94e8-d65aa15b2336", "content-length": "702", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3832025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
3842025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "194feedd-a824-40a2-bb29-dcd3d3274cc1", "content-length": "727", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3852025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
3862025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "48bfc352-667b-4658-8190-ced7d82d361f", "content-length": "729", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3872025-01-15T00:45:37.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
3882025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9d66192-538c-4229-82b1-92bf632c56e0", "content-length": "728", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3892025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
3902025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "85f71424-8014-4151-a816-511f22f8f167", "content-length": "722", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3912025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
3922025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a7849f5-7f08-403b-83d0-54d80b471fed", "content-length": "109", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3932025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
3942025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff283dba-03da-47bc-8d7f-e04b90183fa0", "content-length": "109", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3952025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
3962025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "36ca5cb6-f9d8-40e2-abb7-ecddbfe479a5", "content-length": "169", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3972025-01-15T00:45:37.323ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
3982025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1da4abec-42d0-4a45-9740-959700af355e", "content-length": "169", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
3992025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
4002025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d606fc0-fce6-4d42-a77e-145857ba3e2d", "content-length": "178", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
4012025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
4022025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7a9c33e-a4da-4591-9806-83886322cacc", "content-length": "178", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
4032025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
4042025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "19e4920f-967c-41cd-ba5f-31f425cf6cbf", "content-length": "702", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
4052025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4062025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "dea49788-76d9-424c-b4d7-1121adaca82f", "content-length": "727", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
4072025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4082025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f71d53d1-46e4-4956-b155-4d3bb6f6ab0d", "content-length": "729", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
4092025-01-15T00:45:37.324ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
4102025-01-15T00:45:37.325ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "de708719-c0f7-4f49-8897-576cce410d6e", "content-length": "728", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
4112025-01-15T00:45:37.325ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4122025-01-15T00:45:37.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4132025-01-15T00:45:37.326ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4142025-01-15T00:45:37.328ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
4152025-01-15T00:45:37.328ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4162025-01-15T00:45:37.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4172025-01-15T00:45:37.330ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4182025-01-15T00:45:37.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
4192025-01-15T00:45:37.332ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4202025-01-15T00:45:37.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4212025-01-15T00:45:37.367ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
4222025-01-15T00:45:37.367ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
4232025-01-15T00:45:37.430ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::1]:33651
4242025-01-15T00:45:37.575ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "a801d880-bd7c-4b10-a5af-d73d206a2470", "content-length": "30783", "date": "Wed, 15 Jan 2025 00:45:37 GMT"} })
4252025-01-15T00:45:37.579ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
4262025-01-15T00:45:37.579ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
4272025-01-15T00:45:37.579ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
4282025-01-15T00:45:37.581ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4292025-01-15T00:45:37.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4302025-01-15T00:45:37.583ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4312025-01-15T00:45:37.584ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
4322025-01-15T00:45:37.589ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4332025-01-15T00:45:37.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4342025-01-15T00:45:37.632ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
4352025-01-15T00:45:37.632ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
4362025-01-15T00:45:37.633ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
4372025-01-15T00:45:37.633ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
4382025-01-15T00:45:37.635ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4392025-01-15T00:45:37.638ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
4402025-01-15T00:45:37.638ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: c52fc7fb-8746-40c6-805b-707ae8abbd97, time_created: 2025-01-15T00:44:52.306609Z, time_modified: 2025-01-15T00:44:52.306609Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
4412025-01-15T00:45:37.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac5350db-dabf-4373-9487-945ed4108bfb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4422025-01-15T00:45:37.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac5350db-dabf-4373-9487-945ed4108bfb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4432025-01-15T00:45:37.844ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2667 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac5350db-dabf-4373-9487-945ed4108bfb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4442025-01-15T00:45:37.870ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::2]:43905
4452025-01-15T00:45:37.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 954aa00f-17c5-4e2a-93ed-41fa070bb5ce roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4462025-01-15T00:45:37.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 954aa00f-17c5-4e2a-93ed-41fa070bb5ce resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4472025-01-15T00:45:37.887ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 0d996814-c4e0-4169-8678-851e25226ae7 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
4482025-01-15T00:45:37.887ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 0d996814-c4e0-4169-8678-851e25226ae7 time_started = 2025-01-15 00:45:37.320368 UTC
4492025-01-15T00:45:37.887ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 611.486678ms iteration = 2 status = {"collection_id":"0d996814-c4e0-4169-8678-851e25226ae7","time_done":"2025-01-15 00:45:37.579960 UTC","time_started":"2025-01-15 00:45:37.320368 UTC"}
4502025-01-15T00:45:37.887ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
4512025-01-15T00:45:37.887ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4522025-01-15T00:45:37.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4532025-01-15T00:45:37.888ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4542025-01-15T00:45:37.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14199 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 954aa00f-17c5-4e2a-93ed-41fa070bb5ce response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4552025-01-15T00:45:37.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
4562025-01-15T00:45:37.891ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4572025-01-15T00:45:37.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4582025-01-15T00:45:37.893ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
4592025-01-15T00:45:37.893ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.351562ms iteration = 4 status = {"error":"rack not yet initialized: c52fc7fb-8746-40c6-805b-707ae8abbd97"}
4602025-01-15T00:45:37.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = ef48324b-c862-4cbe-a5f7-0599d8e0840d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4612025-01-15T00:45:37.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = ef48324b-c862-4cbe-a5f7-0599d8e0840d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4622025-01-15T00:45:37.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10504 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = ef48324b-c862-4cbe-a5f7-0599d8e0840d response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4632025-01-15T00:45:37.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0e3e125d-ccd9-4f2c-bd4c-07b476004b16 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4642025-01-15T00:45:37.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0e3e125d-ccd9-4f2c-bd4c-07b476004b16 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4652025-01-15T00:45:37.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7475 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0e3e125d-ccd9-4f2c-bd4c-07b476004b16 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4662025-01-15T00:45:37.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 17375026-88e7-430c-b09e-c7cdec4680e6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4672025-01-15T00:45:37.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 17375026-88e7-430c-b09e-c7cdec4680e6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4682025-01-15T00:45:37.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 17375026-88e7-430c-b09e-c7cdec4680e6 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4692025-01-15T00:45:37.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 17695d8b-15ba-4ab6-be3b-1959a6c40579 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4702025-01-15T00:45:37.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 17695d8b-15ba-4ab6-be3b-1959a6c40579 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4712025-01-15T00:45:37.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23573 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 17695d8b-15ba-4ab6-be3b-1959a6c40579 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4722025-01-15T00:45:37.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = b6f14ec4-66a3-432a-a23b-57e19bca8b8a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4732025-01-15T00:45:37.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = b6f14ec4-66a3-432a-a23b-57e19bca8b8a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4742025-01-15T00:45:37.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8705 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = b6f14ec4-66a3-432a-a23b-57e19bca8b8a response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4752025-01-15T00:45:37.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 6e93c441-4886-4241-b00a-ecac91bd7dbc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4762025-01-15T00:45:37.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 6e93c441-4886-4241-b00a-ecac91bd7dbc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4772025-01-15T00:45:37.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 6e93c441-4886-4241-b00a-ecac91bd7dbc response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4782025-01-15T00:45:37.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 4dec2180-0d2b-4928-94d9-68749402a8b4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4792025-01-15T00:45:37.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 4dec2180-0d2b-4928-94d9-68749402a8b4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4802025-01-15T00:45:37.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2578 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 4dec2180-0d2b-4928-94d9-68749402a8b4 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4812025-01-15T00:45:37.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = a070deb0-ffbb-44d3-8b9c-2e388681a064 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4822025-01-15T00:45:37.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = a070deb0-ffbb-44d3-8b9c-2e388681a064 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4832025-01-15T00:45:37.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = a070deb0-ffbb-44d3-8b9c-2e388681a064 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4842025-01-15T00:45:37.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8a154dab-a1c6-4dc7-8ddf-7169a4c09b6d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4852025-01-15T00:45:37.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8a154dab-a1c6-4dc7-8ddf-7169a4c09b6d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4862025-01-15T00:45:37.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2785 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8a154dab-a1c6-4dc7-8ddf-7169a4c09b6d response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4872025-01-15T00:45:37.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = d1fbfe11-2797-4e12-a016-af79feb3f731 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4882025-01-15T00:45:37.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = d1fbfe11-2797-4e12-a016-af79feb3f731 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4892025-01-15T00:45:37.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = d1fbfe11-2797-4e12-a016-af79feb3f731 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4902025-01-15T00:45:37.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0fafa90f-aec8-4871-816d-9983082561f5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
4912025-01-15T00:45:37.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0fafa90f-aec8-4871-816d-9983082561f5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
4922025-01-15T00:45:37.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0fafa90f-aec8-4871-816d-9983082561f5 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
4932025-01-15T00:45:38.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8a5721f1-5376-4adb-90f1-364f21b61fd4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4942025-01-15T00:45:38.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8a5721f1-5376-4adb-90f1-364f21b61fd4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4952025-01-15T00:45:38.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2078 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8a5721f1-5376-4adb-90f1-364f21b61fd4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
4962025-01-15T00:45:39.639ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
4972025-01-15T00:45:39.639ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
4982025-01-15T00:45:39.640ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
4992025-01-15T00:45:39.641ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
5002025-01-15T00:45:39.642ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5012025-01-15T00:45:39.645ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: c52fc7fb-8746-40c6-805b-707ae8abbd97, lookup_type: ById(c52fc7fb-8746-40c6-805b-707ae8abbd97) } result = Ok(())
5022025-01-15T00:45:39.645ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
5032025-01-15T00:45:39.645ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5042025-01-15T00:45:39.645ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5052025-01-15T00:45:39.651ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5062025-01-15T00:45:39.652ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5072025-01-15T00:45:39.653ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5082025-01-15T00:45:39.653ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5092025-01-15T00:45:39.655ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5102025-01-15T00:45:39.655ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5112025-01-15T00:45:39.656ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5122025-01-15T00:45:39.657ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5132025-01-15T00:45:39.658ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5142025-01-15T00:45:39.658ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5152025-01-15T00:45:39.659ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5162025-01-15T00:45:39.662ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5172025-01-15T00:45:39.662ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5182025-01-15T00:45:39.662ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5192025-01-15T00:45:39.663ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5202025-01-15T00:45:39.664ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5212025-01-15T00:45:39.665ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5222025-01-15T00:45:39.665ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5232025-01-15T00:45:39.666ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5242025-01-15T00:45:39.669ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5252025-01-15T00:45:39.669ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5262025-01-15T00:45:39.669ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5272025-01-15T00:45:39.672ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5282025-01-15T00:45:39.672ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5292025-01-15T00:45:39.673ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5302025-01-15T00:45:39.674ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5312025-01-15T00:45:39.675ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5322025-01-15T00:45:39.675ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5332025-01-15T00:45:39.676ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5342025-01-15T00:45:39.676ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5352025-01-15T00:45:39.677ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5362025-01-15T00:45:39.678ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5372025-01-15T00:45:39.679ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5382025-01-15T00:45:39.679ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5392025-01-15T00:45:39.680ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5402025-01-15T00:45:39.683ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5412025-01-15T00:45:39.683ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5422025-01-15T00:45:39.683ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5432025-01-15T00:45:39.684ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5442025-01-15T00:45:39.684ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5452025-01-15T00:45:39.686ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5462025-01-15T00:45:39.686ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5472025-01-15T00:45:39.687ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5482025-01-15T00:45:39.687ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5492025-01-15T00:45:39.689ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5502025-01-15T00:45:39.689ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5512025-01-15T00:45:39.690ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5522025-01-15T00:45:39.691ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5532025-01-15T00:45:39.692ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5542025-01-15T00:45:39.692ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5552025-01-15T00:45:39.693ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5562025-01-15T00:45:39.698ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
5572025-01-15T00:45:39.698ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5582025-01-15T00:45:39.699ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5592025-01-15T00:45:39.699ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5602025-01-15T00:45:39.700ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5612025-01-15T00:45:39.701ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5622025-01-15T00:45:39.701ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5632025-01-15T00:45:39.702ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5642025-01-15T00:45:39.705ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
5652025-01-15T00:45:39.705ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5662025-01-15T00:45:39.705ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5672025-01-15T00:45:39.717ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5682025-01-15T00:45:39.717ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5692025-01-15T00:45:39.718ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5702025-01-15T00:45:39.719ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5712025-01-15T00:45:39.720ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5722025-01-15T00:45:39.720ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5732025-01-15T00:45:39.722ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5742025-01-15T00:45:39.722ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5752025-01-15T00:45:39.724ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5762025-01-15T00:45:39.724ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5772025-01-15T00:45:39.725ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5782025-01-15T00:45:39.725ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5792025-01-15T00:45:39.726ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5802025-01-15T00:45:39.727ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5812025-01-15T00:45:39.727ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822025-01-15T00:45:39.731ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
5832025-01-15T00:45:39.731ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5842025-01-15T00:45:39.731ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5852025-01-15T00:45:39.734ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5862025-01-15T00:45:39.734ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5872025-01-15T00:45:39.735ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5882025-01-15T00:45:39.735ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5892025-01-15T00:45:39.737ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5902025-01-15T00:45:39.740ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
5912025-01-15T00:45:39.740ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5922025-01-15T00:45:39.740ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5932025-01-15T00:45:39.746ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
5942025-01-15T00:45:39.746ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5952025-01-15T00:45:39.746ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
5962025-01-15T00:45:39.748ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5972025-01-15T00:45:39.750ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
5982025-01-15T00:45:39.750ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
5992025-01-15T00:45:39.750ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
6002025-01-15T00:45:39.758ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
6012025-01-15T00:45:39.766ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
6022025-01-15T00:45:39.766ZDEBGnexus (InternalApi): resolved 2 rules for sleds
6032025-01-15T00:45:39.821ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, time_created: 2025-01-15T00:45:37.185922Z, time_modified: 2025-01-15T00:45:37.185922Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
6042025-01-15T00:45:39.821ZDEBGnexus (InternalApi): sending firewall rules to sled agents
6052025-01-15T00:45:39.821ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
6062025-01-15T00:45:39.824ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
6072025-01-15T00:45:39.826ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
6082025-01-15T00:45:39.827ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
6092025-01-15T00:45:39.828ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6102025-01-15T00:45:39.830ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
6112025-01-15T00:45:39.868ZDEBGnexus (InternalApi): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
6122025-01-15T00:45:39.868ZDEBGnexus (InternalApi): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "d1003acf-757c-4dcc-aad0-5bc90b4fb794", "date": "Wed, 15 Jan 2025 00:45:39 GMT"} })
6132025-01-15T00:45:39.869ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
6142025-01-15T00:45:39.869ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
6152025-01-15T00:45:39.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d75be97-e8ad-4bcd-884b-b6117f03ee49 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6162025-01-15T00:45:39.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d75be97-e8ad-4bcd-884b-b6117f03ee49 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6172025-01-15T00:45:39.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9539 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d75be97-e8ad-4bcd-884b-b6117f03ee49 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6182025-01-15T00:45:40.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9dc9e19d-6433-4e4d-9036-dfd0e18d1cff roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6192025-01-15T00:45:40.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9dc9e19d-6433-4e4d-9036-dfd0e18d1cff resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6202025-01-15T00:45:40.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9dc9e19d-6433-4e4d-9036-dfd0e18d1cff response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6212025-01-15T00:45:41.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbfa9063-4d19-418a-8352-e47adbd7e304 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6222025-01-15T00:45:41.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbfa9063-4d19-418a-8352-e47adbd7e304 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6232025-01-15T00:45:41.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbfa9063-4d19-418a-8352-e47adbd7e304 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
6242025-01-15T00:45:42.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
6252025-01-15T00:45:42.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6262025-01-15T00:45:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6272025-01-15T00:45:42.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6282025-01-15T00:45:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6292025-01-15T00:45:42.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6302025-01-15T00:45:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6312025-01-15T00:45:42.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
6322025-01-15T00:45:42.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6332025-01-15T00:45:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6342025-01-15T00:45:42.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6352025-01-15T00:45:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6362025-01-15T00:45:42.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6372025-01-15T00:45:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6382025-01-15T00:45:42.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6392025-01-15T00:45:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
6402025-01-15T00:45:42.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6412025-01-15T00:45:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6422025-01-15T00:45:42.631ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
6432025-01-15T00:45:42.631ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.508158ms iteration = 6 status = {"enabled":false,"status":"first target blueprint","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z","time_found":"2025-01-15T00:45:42.631540394Z"}
6442025-01-15T00:45:42.631ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
6452025-01-15T00:45:42.631ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
6462025-01-15T00:45:42.631ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
6472025-01-15T00:45:42.631ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 5.701\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
6482025-01-15T00:45:42.631ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6492025-01-15T00:45:42.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6502025-01-15T00:45:42.631ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6512025-01-15T00:45:42.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6522025-01-15T00:45:42.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6532025-01-15T00:45:42.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6542025-01-15T00:45:42.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6552025-01-15T00:45:42.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6562025-01-15T00:45:42.632ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6572025-01-15T00:45:42.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6582025-01-15T00:45:42.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6592025-01-15T00:45:42.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6602025-01-15T00:45:42.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6612025-01-15T00:45:42.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6622025-01-15T00:45:42.635ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6632025-01-15T00:45:42.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6642025-01-15T00:45:42.637ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6652025-01-15T00:45:42.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6662025-01-15T00:45:42.637ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6672025-01-15T00:45:42.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6682025-01-15T00:45:42.639ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6692025-01-15T00:45:42.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6702025-01-15T00:45:42.639ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6712025-01-15T00:45:42.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6722025-01-15T00:45:42.641ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6732025-01-15T00:45:42.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6742025-01-15T00:45:42.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.644182ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6752025-01-15T00:45:42.674ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
6762025-01-15T00:45:42.705ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
6772025-01-15T00:45:42.737ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
6782025-01-15T00:45:42.738ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6792025-01-15T00:45:42.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6802025-01-15T00:45:42.740ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6812025-01-15T00:45:42.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6822025-01-15T00:45:42.772ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
6832025-01-15T00:45:42.806ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
6842025-01-15T00:45:42.931ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50338b8a-f15d-4e79-8c29-f7698f5b2047", "content-length": "64", "date": "Wed, 15 Jan 2025 00:45:42 GMT"} })
6852025-01-15T00:45:42.931ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6862025-01-15T00:45:42.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6872025-01-15T00:45:42.932ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6882025-01-15T00:45:42.933ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6892025-01-15T00:45:42.933ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6902025-01-15T00:45:42.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6912025-01-15T00:45:42.935ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff4dda06-192e-4717-a5e3-9b2d6f7e2264", "content-length": "64", "date": "Wed, 15 Jan 2025 00:45:42 GMT"} })
6922025-01-15T00:45:42.935ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6932025-01-15T00:45:42.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6942025-01-15T00:45:42.938ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6952025-01-15T00:45:42.939ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6962025-01-15T00:45:42.939ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6972025-01-15T00:45:42.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6982025-01-15T00:45:42.958ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "574e1d8c-c325-4a2a-8843-363f8c8acba7", "content-length": "64", "date": "Wed, 15 Jan 2025 00:45:42 GMT"} })
6992025-01-15T00:45:42.958ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7002025-01-15T00:45:42.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7012025-01-15T00:45:42.960ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7022025-01-15T00:45:42.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea2ba4d6-5a16-4e39-9b64-dbece4392d9f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7032025-01-15T00:45:42.961ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7042025-01-15T00:45:42.961ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7052025-01-15T00:45:42.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7062025-01-15T00:45:42.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea2ba4d6-5a16-4e39-9b64-dbece4392d9f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7072025-01-15T00:45:42.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4084 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea2ba4d6-5a16-4e39-9b64-dbece4392d9f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7082025-01-15T00:45:43.073ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "320db263-f071-4d0f-9c72-91599e05dd5f", "content-length": "64", "date": "Wed, 15 Jan 2025 00:45:43 GMT"} })
7092025-01-15T00:45:43.073ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7102025-01-15T00:45:43.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7112025-01-15T00:45:43.075ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7122025-01-15T00:45:43.076ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7132025-01-15T00:45:43.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7142025-01-15T00:45:43.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7152025-01-15T00:45:43.135ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57b3ff18-a203-49df-99e8-0793aa159e14", "content-length": "64", "date": "Wed, 15 Jan 2025 00:45:43 GMT"} })
7162025-01-15T00:45:43.135ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7172025-01-15T00:45:43.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7182025-01-15T00:45:43.136ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7192025-01-15T00:45:43.138ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7202025-01-15T00:45:43.138ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7212025-01-15T00:45:43.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7222025-01-15T00:45:43.145ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 514.235257ms iteration = 2 status = {"nsuccess":5}
7232025-01-15T00:45:43.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f8ad178-7be7-4de7-8856-3282c461c8e5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7242025-01-15T00:45:43.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f8ad178-7be7-4de7-8856-3282c461c8e5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7252025-01-15T00:45:44.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98308 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f8ad178-7be7-4de7-8856-3282c461c8e5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7262025-01-15T00:45:45.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d913f5c-6db0-46a6-aedc-b59feefc527e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7272025-01-15T00:45:45.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d913f5c-6db0-46a6-aedc-b59feefc527e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7282025-01-15T00:45:45.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110766 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d913f5c-6db0-46a6-aedc-b59feefc527e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7292025-01-15T00:45:46.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77d9c505-4687-4461-8deb-2408dcd1249f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7302025-01-15T00:45:46.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77d9c505-4687-4461-8deb-2408dcd1249f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7312025-01-15T00:45:46.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108752 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77d9c505-4687-4461-8deb-2408dcd1249f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7322025-01-15T00:45:47.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7e119955-2699-4458-aaab-efd29dbed24e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7332025-01-15T00:45:47.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7e119955-2699-4458-aaab-efd29dbed24e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7342025-01-15T00:45:47.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7e119955-2699-4458-aaab-efd29dbed24e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7352025-01-15T00:45:48.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80cc80c0-5239-461a-abc2-7e0fc6e09a25 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7362025-01-15T00:45:48.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80cc80c0-5239-461a-abc2-7e0fc6e09a25 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7372025-01-15T00:45:48.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80cc80c0-5239-461a-abc2-7e0fc6e09a25 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7382025-01-15T00:45:49.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f5e1242-1d5d-47e1-a129-324a596337e7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7392025-01-15T00:45:49.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f5e1242-1d5d-47e1-a129-324a596337e7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7402025-01-15T00:45:49.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2662 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f5e1242-1d5d-47e1-a129-324a596337e7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7412025-01-15T00:45:50.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b5981ea-bbf8-4bc5-9c1b-c8f36c56cbc8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7422025-01-15T00:45:50.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b5981ea-bbf8-4bc5-9c1b-c8f36c56cbc8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7432025-01-15T00:45:50.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b5981ea-bbf8-4bc5-9c1b-c8f36c56cbc8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7442025-01-15T00:45:51.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = afa08b78-4751-4761-888d-03e289a1cb7d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7452025-01-15T00:45:51.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = afa08b78-4751-4761-888d-03e289a1cb7d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7462025-01-15T00:45:51.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = afa08b78-4751-4761-888d-03e289a1cb7d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7472025-01-15T00:45:52.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7085e032-caf4-49e4-b28b-1b939ad94287 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7482025-01-15T00:45:52.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7085e032-caf4-49e4-b28b-1b939ad94287 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7492025-01-15T00:45:52.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7085e032-caf4-49e4-b28b-1b939ad94287 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
7502025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
7512025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
7522025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
7532025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7542025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
7552025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
7562025-01-15T00:45:52.603ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
7572025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
7582025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 6.21\u{b5}s iteration = 3 status = {"error":"no config"}
7592025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
7602025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
7612025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
7622025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7632025-01-15T00:45:52.603ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
7642025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 6.469\u{b5}s iteration = 3 status = {"error":"no config"}
7652025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
7662025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
7672025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
7682025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
7692025-01-15T00:45:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
7702025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7712025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
7722025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.73\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
7732025-01-15T00:45:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:35:52.603297421 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
7742025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
7752025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
7762025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
7772025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7782025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7792025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7802025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7812025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7822025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7832025-01-15T00:45:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 972, tv_nsec: 933540577 } })
7842025-01-15T00:45:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 972, tv_nsec: 933542937 } })
7852025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
7862025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
7872025-01-15T00:45:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7882025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
7892025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.088411ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
7902025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
7912025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.267544ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
7922025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
7932025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
7942025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7952025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7962025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
7972025-01-15T00:45:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
7982025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 3 reason = Timeout
7992025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8002025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8012025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
8022025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8032025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8042025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8052025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8062025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8072025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8082025-01-15T00:45:52.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8092025-01-15T00:45:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8102025-01-15T00:45:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8112025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8122025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8132025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.280822ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
8142025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
8152025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
8162025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
8172025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
8182025-01-15T00:45:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
8192025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8202025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8212025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
8222025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
8232025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8242025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
8252025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
8262025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
8272025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
8282025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
8292025-01-15T00:45:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
8302025-01-15T00:45:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 972, tv_nsec: 937611525 } })
8312025-01-15T00:45:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8322025-01-15T00:45:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
8332025-01-15T00:45:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8342025-01-15T00:45:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8352025-01-15T00:45:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
8362025-01-15T00:45:52.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
8372025-01-15T00:45:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
8382025-01-15T00:45:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
8392025-01-15T00:45:52.608ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:35:52.603297421 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
8402025-01-15T00:45:52.608ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.480715ms iteration = 2 status = {"expiration":"2025-01-15T00:35:52.603297421Z","pruned":[]}
8412025-01-15T00:45:52.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8422025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
8432025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
8442025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
8452025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
8462025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
8472025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
8482025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
8492025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
8502025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
8512025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
8522025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
8532025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
8542025-01-15T00:45:52.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 972, tv_nsec: 940118693 } })
8552025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
8562025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
8572025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
8582025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
8592025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
8602025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
8612025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
8622025-01-15T00:45:52.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
8632025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
8642025-01-15T00:45:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
8652025-01-15T00:45:52.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
8662025-01-15T00:45:52.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
8672025-01-15T00:45:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
8682025-01-15T00:45:52.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8692025-01-15T00:45:52.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8702025-01-15T00:45:52.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8712025-01-15T00:45:52.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8722025-01-15T00:45:52.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8732025-01-15T00:45:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
8742025-01-15T00:45:52.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8752025-01-15T00:45:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8762025-01-15T00:45:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
8772025-01-15T00:45:52.616ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
8782025-01-15T00:45:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
8792025-01-15T00:45:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8802025-01-15T00:45:52.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8812025-01-15T00:45:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8822025-01-15T00:45:52.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8832025-01-15T00:45:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
8842025-01-15T00:45:52.617ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
8852025-01-15T00:45:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
8862025-01-15T00:45:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
8872025-01-15T00:45:52.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8882025-01-15T00:45:52.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8892025-01-15T00:45:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8902025-01-15T00:45:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8912025-01-15T00:45:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8922025-01-15T00:45:52.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
8932025-01-15T00:45:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
8942025-01-15T00:45:52.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8952025-01-15T00:45:52.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8962025-01-15T00:45:52.626ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.534718ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
8972025-01-15T00:45:52.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
8982025-01-15T00:45:52.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8992025-01-15T00:45:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
9002025-01-15T00:45:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
9012025-01-15T00:45:52.627ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
9022025-01-15T00:45:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
9032025-01-15T00:45:52.629ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9042025-01-15T00:45:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9052025-01-15T00:45:52.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9062025-01-15T00:45:52.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9072025-01-15T00:45:52.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9082025-01-15T00:45:52.632ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9092025-01-15T00:45:52.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9102025-01-15T00:45:52.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9112025-01-15T00:45:52.632ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 972, tv_nsec: 962392832 } })
9122025-01-15T00:45:52.633ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
9132025-01-15T00:45:52.633ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9142025-01-15T00:45:52.633ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
9152025-01-15T00:45:52.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9162025-01-15T00:45:52.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
9172025-01-15T00:45:52.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9182025-01-15T00:45:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9192025-01-15T00:45:52.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9202025-01-15T00:45:52.638ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
9212025-01-15T00:45:52.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
9222025-01-15T00:45:52.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
9232025-01-15T00:45:52.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9242025-01-15T00:45:52.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9252025-01-15T00:45:52.642ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9262025-01-15T00:45:52.642ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9272025-01-15T00:45:52.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9282025-01-15T00:45:52.645ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9292025-01-15T00:45:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9302025-01-15T00:45:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
9312025-01-15T00:45:52.646ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
9322025-01-15T00:45:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
9332025-01-15T00:45:52.648ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
9342025-01-15T00:45:52.648ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 40.713114ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
9352025-01-15T00:45:52.651ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9362025-01-15T00:45:52.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9372025-01-15T00:45:52.661ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
9382025-01-15T00:45:52.661ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
9392025-01-15T00:45:52.661ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
9402025-01-15T00:45:52.661ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9412025-01-15T00:45:52.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9422025-01-15T00:45:52.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9432025-01-15T00:45:52.664ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
9442025-01-15T00:45:52.664ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.31475ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
9452025-01-15T00:45:52.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9462025-01-15T00:45:52.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9472025-01-15T00:45:52.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9482025-01-15T00:45:52.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
9492025-01-15T00:45:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
9502025-01-15T00:45:52.671ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9512025-01-15T00:45:52.675ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
9522025-01-15T00:45:52.675ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
9532025-01-15T00:45:52.675ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
9542025-01-15T00:45:52.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9552025-01-15T00:45:52.675ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9562025-01-15T00:45:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9572025-01-15T00:45:52.675ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 68.156092ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
9582025-01-15T00:45:52.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
9592025-01-15T00:45:52.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9602025-01-15T00:45:52.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9612025-01-15T00:45:52.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
9622025-01-15T00:45:52.677ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
9632025-01-15T00:45:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
9642025-01-15T00:45:52.678ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9652025-01-15T00:45:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9662025-01-15T00:45:52.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9672025-01-15T00:45:52.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9682025-01-15T00:45:52.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
9692025-01-15T00:45:52.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
9702025-01-15T00:45:52.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
9712025-01-15T00:45:52.681ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
9722025-01-15T00:45:52.681ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
9732025-01-15T00:45:52.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
9742025-01-15T00:45:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
9752025-01-15T00:45:52.681ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
9762025-01-15T00:45:52.681ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
9772025-01-15T00:45:52.681ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.451321ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
9782025-01-15T00:45:52.682ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
9792025-01-15T00:45:52.682ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
9802025-01-15T00:45:52.682ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 71.964275ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
9812025-01-15T00:45:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
9822025-01-15T00:45:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
9832025-01-15T00:45:52.682ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
9842025-01-15T00:45:52.682ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
9852025-01-15T00:45:52.682ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
9862025-01-15T00:45:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
9872025-01-15T00:45:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
9882025-01-15T00:45:52.683ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
9892025-01-15T00:45:52.683ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f421dbdd-013f-450d-961e-d2f81eda470f", "content-length": "26", "date": "Wed, 15 Jan 2025 00:45:51 GMT"} })
9902025-01-15T00:45:52.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
9912025-01-15T00:45:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
9922025-01-15T00:45:52.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.401283ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
9932025-01-15T00:45:52.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.177735ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9942025-01-15T00:45:52.684ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
9952025-01-15T00:45:52.685ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
9962025-01-15T00:45:52.685ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
9972025-01-15T00:45:52.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
9982025-01-15T00:45:52.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
9992025-01-15T00:45:52.685ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10002025-01-15T00:45:52.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10012025-01-15T00:45:52.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 76.335219ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
10022025-01-15T00:45:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10032025-01-15T00:45:52.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10042025-01-15T00:45:52.687ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10052025-01-15T00:45:52.687ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10062025-01-15T00:45:52.687ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
10072025-01-15T00:45:52.687ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10082025-01-15T00:45:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10092025-01-15T00:45:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10102025-01-15T00:45:52.689ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10112025-01-15T00:45:52.689ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10122025-01-15T00:45:52.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10132025-01-15T00:45:52.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10142025-01-15T00:45:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
10152025-01-15T00:45:52.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10162025-01-15T00:45:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10172025-01-15T00:45:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
10182025-01-15T00:45:52.692ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10192025-01-15T00:45:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10202025-01-15T00:45:52.693ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10212025-01-15T00:45:52.695ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
10222025-01-15T00:45:52.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10232025-01-15T00:45:52.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10242025-01-15T00:45:52.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 86.567866ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
10252025-01-15T00:45:52.696ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
10262025-01-15T00:45:52.696ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 92.145973ms iteration = 3 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
10272025-01-15T00:45:52.697ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
10282025-01-15T00:45:52.697ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
10292025-01-15T00:45:52.697ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
10302025-01-15T00:45:52.697ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 94.516339ms iteration = 2 status = {"generation":2}
10312025-01-15T00:45:52.697ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
10322025-01-15T00:45:52.698ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 93.901147ms iteration = 3 status = 0
10332025-01-15T00:45:52.713ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
10342025-01-15T00:45:52.713ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
10352025-01-15T00:45:52.713ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "794fb306-466e-4d09-b1e6-2b2cbfa98ba4", "content-length": "26", "date": "Wed, 15 Jan 2025 00:45:51 GMT"} })
10362025-01-15T00:45:52.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
10372025-01-15T00:45:52.716ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
10382025-01-15T00:45:52.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 112.366902ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
10392025-01-15T00:45:52.724ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
10402025-01-15T00:45:52.724ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
10412025-01-15T00:45:52.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10422025-01-15T00:45:52.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10432025-01-15T00:45:52.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10442025-01-15T00:45:52.729ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
10452025-01-15T00:45:52.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10462025-01-15T00:45:52.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10472025-01-15T00:45:52.732ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
10482025-01-15T00:45:52.732ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
10492025-01-15T00:45:52.732ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
10502025-01-15T00:45:52.732ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 128.976612ms iteration = 2 status = {"generation":1}
10512025-01-15T00:45:52.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
10522025-01-15T00:45:52.740ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
10532025-01-15T00:45:52.740ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
10542025-01-15T00:45:52.740ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 132.50944ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
10552025-01-15T00:45:52.747ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
10562025-01-15T00:45:52.747ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 140.101097ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
10572025-01-15T00:45:52.759ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
10582025-01-15T00:45:52.759ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 156.192896ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
10592025-01-15T00:45:52.776ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.253685ms iteration = 5 status = {"physical_disks_added":0}
10602025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = / versions = all
10612025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /access versions = all
10622025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /assets/{path} versions = all
10632025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /device/auth versions = all
10642025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /device/confirm versions = all
10652025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /device/success versions = all
10662025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /device/token versions = all
10672025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /device/verify versions = all
10682025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /experimental/v1/probes versions = all
10692025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /experimental/v1/probes versions = all
10702025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
10712025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /experimental/v1/probes/{probe} versions = all
10722025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /experimental/v1/system/support-bundles versions = all
10732025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /experimental/v1/system/support-bundles versions = all
10742025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
10752025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
10762025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
10772025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
10782025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
10792025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
10802025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
10812025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /images versions = all
10822025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /login versions = all
10832025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /login/{silo_name}/local versions = all
10842025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
10852025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
10862025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
10872025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /lookup/{path} versions = all
10882025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /projects/{path} versions = all
10892025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /projects-new versions = all
10902025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /settings/{path} versions = all
10912025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /system/{path} versions = all
10922025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /utilization versions = all
10932025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/certificates versions = all
10942025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/certificates versions = all
10952025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/certificates/{certificate} versions = all
10962025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/certificates/{certificate} versions = all
10972025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/disks versions = all
10982025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/disks versions = all
10992025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/disks/{disk} versions = all
11002025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/disks/{disk} versions = all
11012025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
11022025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
11032025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
11042025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/disks/{disk}/finalize versions = all
11052025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
11062025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/floating-ips versions = all
11072025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/floating-ips versions = all
11082025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
11092025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
11102025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
11112025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
11122025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
11132025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/groups versions = all
11142025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/groups/{group_id} versions = all
11152025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/images versions = all
11162025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/images versions = all
11172025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/images/{image} versions = all
11182025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/images/{image} versions = all
11192025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/images/{image}/demote versions = all
11202025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/images/{image}/promote versions = all
11212025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/instances versions = all
11222025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/instances versions = all
11232025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/instances/{instance} versions = all
11242025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/instances/{instance} versions = all
11252025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/instances/{instance} versions = all
11262025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/instances/{instance}/disks versions = all
11272025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
11282025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
11292025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
11302025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
11312025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
11322025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/instances/{instance}/reboot versions = all
11332025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
11342025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
11352025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
11362025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/instances/{instance}/start versions = all
11372025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/instances/{instance}/stop versions = all
11382025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
11392025-01-15T00:45:52.789ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
11402025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
11412025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
11422025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
11432025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
11442025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/internet-gateways versions = all
11452025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/internet-gateways versions = all
11462025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
11472025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
11482025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/ip-pools versions = all
11492025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/ip-pools/{pool} versions = all
11502025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/login/{silo_name}/local versions = all
11512025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/logout versions = all
11522025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/me versions = all
11532025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/me/groups versions = all
11542025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/me/ssh-keys versions = all
11552025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/me/ssh-keys versions = all
11562025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
11572025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
11582025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/metrics/{metric_name} versions = all
11592025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/network-interfaces versions = all
11602025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/network-interfaces versions = all
11612025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
11622025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/network-interfaces/{interface} versions = all
11632025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
11642025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/ping versions = all
11652025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/policy versions = all
11662025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/policy versions = all
11672025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/projects versions = all
11682025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/projects versions = all
11692025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/projects/{project} versions = all
11702025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/projects/{project} versions = all
11712025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/projects/{project} versions = all
11722025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/projects/{project}/policy versions = all
11732025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/projects/{project}/policy versions = all
11742025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/snapshots versions = all
11752025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/snapshots versions = all
11762025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
11772025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/snapshots/{snapshot} versions = all
11782025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/disks versions = all
11792025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
11802025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/racks versions = all
11812025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
11822025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/sleds versions = all
11832025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/hardware/sleds versions = all
11842025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
11852025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
11862025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
11872025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
11882025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
11892025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/switch-port versions = all
11902025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
11912025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
11922025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
11932025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/switches versions = all
11942025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
11952025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/identity-providers versions = all
11962025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/identity-providers/local/users versions = all
11972025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
11982025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
11992025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/identity-providers/saml versions = all
12002025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
12012025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/ip-pools versions = all
12022025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/ip-pools versions = all
12032025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
12042025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
12052025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
12062025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
12072025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
12082025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
12092025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
12102025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
12112025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
12122025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
12132025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
12142025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/ip-pools-service versions = all
12152025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
12162025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
12172025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
12182025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
12192025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/address-lot versions = all
12202025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/networking/address-lot versions = all
12212025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
12222025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
12232025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/allow-list versions = all
12242025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/networking/allow-list versions = all
12252025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/networking/bfd-disable versions = all
12262025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/networking/bfd-enable versions = all
12272025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/bfd-status versions = all
12282025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/networking/bgp versions = all
12292025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/bgp versions = all
12302025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/networking/bgp versions = all
12312025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
12322025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
12332025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
12342025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
12352025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/bgp-exported versions = all
12362025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
12372025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
12382025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/bgp-status versions = all
12392025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/loopback-address versions = all
12402025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/networking/loopback-address versions = all
12412025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
12422025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
12432025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
12442025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
12452025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
12462025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/policy versions = all
12472025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/policy versions = all
12482025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/roles versions = all
12492025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/roles/{role_name} versions = all
12502025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/silo-quotas versions = all
12512025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/silos versions = all
12522025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/silos versions = all
12532025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/system/silos/{silo} versions = all
12542025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/silos/{silo} versions = all
12552025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
12562025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
12572025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
12582025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
12592025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
12602025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/system/timeseries/query versions = all
12612025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/timeseries/schemas versions = all
12622025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/system/update/repository versions = all
12632025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
12642025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/users versions = all
12652025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/users/{user_id} versions = all
12662025-01-15T00:45:52.790ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/users-builtin versions = all
12672025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/users-builtin/{user} versions = all
12682025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/utilization/silos versions = all
12692025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
12702025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/timeseries/query versions = all
12712025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/users versions = all
12722025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/utilization versions = all
12732025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpc-firewall-rules versions = all
12742025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/vpc-firewall-rules versions = all
12752025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpc-router-routes versions = all
12762025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/vpc-router-routes versions = all
12772025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
12782025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
12792025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
12802025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpc-routers versions = all
12812025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/vpc-routers versions = all
12822025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
12832025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpc-routers/{router} versions = all
12842025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/vpc-routers/{router} versions = all
12852025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpc-subnets versions = all
12862025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/vpc-subnets versions = all
12872025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
12882025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
12892025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
12902025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
12912025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpcs versions = all
12922025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = POST path = /v1/vpcs versions = all
12932025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
12942025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = GET path = /v1/vpcs/{vpc} versions = all
12952025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.5:443 method = PUT path = /v1/vpcs/{vpc} versions = all
12962025-01-15T00:45:52.791ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.5:443
12972025-01-15T00:45:52.791ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.5:443
12982025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = / versions = all
12992025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /access versions = all
13002025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /assets/{path} versions = all
13012025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /device/auth versions = all
13022025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /device/confirm versions = all
13032025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /device/success versions = all
13042025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /device/token versions = all
13052025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /device/verify versions = all
13062025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /experimental/v1/probes versions = all
13072025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /experimental/v1/probes versions = all
13082025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
13092025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
13102025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /experimental/v1/system/support-bundles versions = all
13112025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /experimental/v1/system/support-bundles versions = all
13122025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
13132025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
13142025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
13152025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
13162025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
13172025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
13182025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
13192025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /images versions = all
13202025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /login versions = all
13212025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /login/{silo_name}/local versions = all
13222025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
13232025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
13242025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
13252025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /lookup/{path} versions = all
13262025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /projects/{path} versions = all
13272025-01-15T00:45:52.796ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /projects-new versions = all
13282025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /settings/{path} versions = all
13292025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /system/{path} versions = all
13302025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /utilization versions = all
13312025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/certificates versions = all
13322025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/certificates versions = all
13332025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
13342025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/certificates/{certificate} versions = all
13352025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/disks versions = all
13362025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/disks versions = all
13372025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/disks/{disk} versions = all
13382025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/disks/{disk} versions = all
13392025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
13402025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
13412025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
13422025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
13432025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
13442025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/floating-ips versions = all
13452025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/floating-ips versions = all
13462025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
13472025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
13482025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
13492025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
13502025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
13512025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/groups versions = all
13522025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/groups/{group_id} versions = all
13532025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/images versions = all
13542025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/images versions = all
13552025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/images/{image} versions = all
13562025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/images/{image} versions = all
13572025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/images/{image}/demote versions = all
13582025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/images/{image}/promote versions = all
13592025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/instances versions = all
13602025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/instances versions = all
13612025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/instances/{instance} versions = all
13622025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/instances/{instance} versions = all
13632025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/instances/{instance} versions = all
13642025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
13652025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
13662025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
13672025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
13682025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
13692025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
13702025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
13712025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
13722025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
13732025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
13742025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/instances/{instance}/start versions = all
13752025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
13762025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
13772025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
13782025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
13792025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
13802025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
13812025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
13822025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/internet-gateways versions = all
13832025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/internet-gateways versions = all
13842025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
13852025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
13862025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/ip-pools versions = all
13872025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
13882025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
13892025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/logout versions = all
13902025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/me versions = all
13912025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/me/groups versions = all
13922025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/me/ssh-keys versions = all
13932025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/me/ssh-keys versions = all
13942025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
13952025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
13962025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
13972025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/network-interfaces versions = all
13982025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/network-interfaces versions = all
13992025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
14002025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
14012025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
14022025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/ping versions = all
14032025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/policy versions = all
14042025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/policy versions = all
14052025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/projects versions = all
14062025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/projects versions = all
14072025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/projects/{project} versions = all
14082025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/projects/{project} versions = all
14092025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/projects/{project} versions = all
14102025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/projects/{project}/policy versions = all
14112025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
14122025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/snapshots versions = all
14132025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/snapshots versions = all
14142025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
14152025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
14162025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/disks versions = all
14172025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
14182025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/racks versions = all
14192025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
14202025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/sleds versions = all
14212025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/hardware/sleds versions = all
14222025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
14232025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
14242025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
14252025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
14262025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
14272025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
14282025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
14292025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
14302025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
14312025-01-15T00:45:52.797ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/switches versions = all
14322025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
14332025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/identity-providers versions = all
14342025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
14352025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
14362025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
14372025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
14382025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
14392025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/ip-pools versions = all
14402025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/ip-pools versions = all
14412025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
14422025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
14432025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
14442025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
14452025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
14462025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
14472025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
14482025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
14492025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
14502025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
14512025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
14522025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/ip-pools-service versions = all
14532025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
14542025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
14552025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
14562025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
14572025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/address-lot versions = all
14582025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/networking/address-lot versions = all
14592025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
14602025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
14612025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/allow-list versions = all
14622025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
14632025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
14642025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
14652025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
14662025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
14672025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/bgp versions = all
14682025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/networking/bgp versions = all
14692025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
14702025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
14712025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
14722025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
14732025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
14742025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
14752025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
14762025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
14772025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
14782025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
14792025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
14802025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
14812025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
14822025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
14832025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
14842025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/policy versions = all
14852025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/policy versions = all
14862025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/roles versions = all
14872025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
14882025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/silo-quotas versions = all
14892025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/silos versions = all
14902025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/silos versions = all
14912025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
14922025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/silos/{silo} versions = all
14932025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
14942025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
14952025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
14962025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
14972025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
14982025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/system/timeseries/query versions = all
14992025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
15002025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/system/update/repository versions = all
15012025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
15022025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/users versions = all
15032025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/users/{user_id} versions = all
15042025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/users-builtin versions = all
15052025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
15062025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/utilization/silos versions = all
15072025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
15082025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/timeseries/query versions = all
15092025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/users versions = all
15102025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/utilization versions = all
15112025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
15122025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
15132025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpc-router-routes versions = all
15142025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/vpc-router-routes versions = all
15152025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
15162025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
15172025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
15182025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpc-routers versions = all
15192025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/vpc-routers versions = all
15202025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
15212025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
15222025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
15232025-01-15T00:45:52.798ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpc-subnets versions = all
15242025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/vpc-subnets versions = all
15252025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
15262025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
15272025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
15282025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
15292025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpcs versions = all
15302025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = POST path = /v1/vpcs versions = all
15312025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
15322025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
15332025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::a]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
15342025-01-15T00:45:52.799ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::a]:12228
15352025-01-15T00:45:52.799ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::a]:12228
15362025-01-15T00:45:52.805ZDEBGnexus (nexus-producer-server): registered DTrace probes
15372025-01-15T00:45:52.820ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
15382025-01-15T00:45:52.820ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15392025-01-15T00:45:52.820ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9be407ce-0784-4df9-8008-fba116743d38", "content-length": "26", "date": "Wed, 15 Jan 2025 00:45:51 GMT"} })
15402025-01-15T00:45:52.820ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15412025-01-15T00:45:52.822ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
15422025-01-15T00:45:52.822ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::a]:51350 method = GET path = /{producer_id} versions = all
15432025-01-15T00:45:52.822ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::a]:51350
15442025-01-15T00:45:52.822ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::a]:51350
15452025-01-15T00:45:52.822ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::a]:51350
15462025-01-15T00:45:52.822ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::a]:12221
15472025-01-15T00:45:52.822ZDEBGnexus (nexus-producer-server): starting producer registration task
15482025-01-15T00:45:52.824ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::a]:51350 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15492025-01-15T00:45:52.824ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
15502025-01-15T00:45:52.824ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
15512025-01-15T00:45:52.864ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
15522025-01-15T00:45:52.864ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b08f5aba-218f-43d4-8623-43d1f5ea22d9", "content-length": "1", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
15532025-01-15T00:45:52.866ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15542025-01-15T00:45:52.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15552025-01-15T00:45:52.868ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 265.619992ms iteration = 3 status = null
15562025-01-15T00:45:52.931ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
15572025-01-15T00:45:52.968ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 364.895323ms iteration = 3 status = {}
15582025-01-15T00:45:52.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = f068996e-64d1-4c0c-8e0a-ac4a318de855 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
15592025-01-15T00:45:52.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = f068996e-64d1-4c0c-8e0a-ac4a318de855 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
15602025-01-15T00:45:52.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = f068996e-64d1-4c0c-8e0a-ac4a318de855 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
15612025-01-15T00:45:52.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = a32dd6da-1773-4047-85f1-2831e3721706 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
15622025-01-15T00:45:52.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = a32dd6da-1773-4047-85f1-2831e3721706 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
15632025-01-15T00:45:53.019ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15642025-01-15T00:45:53.019ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "860d17b7-a1b7-46c6-8136-03d28f3ceb64", "content-length": "691", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
15652025-01-15T00:45:53.019ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15662025-01-15T00:45:53.019ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15672025-01-15T00:45:53.019ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15682025-01-15T00:45:53.021ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 413.759003ms iteration = 3 status = {}
15692025-01-15T00:45:53.025ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
15702025-01-15T00:45:53.086ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15712025-01-15T00:45:53.086ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15722025-01-15T00:45:53.086ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "009df9b8-a0d7-4e8f-bf99-411e1d6d2386", "content-length": "372", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
15732025-01-15T00:45:53.088ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
15742025-01-15T00:45:53.088ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15752025-01-15T00:45:53.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15762025-01-15T00:45:53.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104980 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = a32dd6da-1773-4047-85f1-2831e3721706 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
15772025-01-15T00:45:53.094ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
15782025-01-15T00:45:53.094ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:65440
15792025-01-15T00:45:53.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:65440 req_id = 9bf00db5-8ecc-4ebd-9e77-0d7e1af71c9d roles = RoleSet { roles: {} } uri = /metrics/producers
15802025-01-15T00:45:53.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:65440 req_id = 9bf00db5-8ecc-4ebd-9e77-0d7e1af71c9d resource = Database result = Ok(()) uri = /metrics/producers
15812025-01-15T00:45:53.136ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15822025-01-15T00:45:53.136ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15832025-01-15T00:45:53.136ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9451bcb9-714e-4475-acfe-33ffbcd949ae", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
15842025-01-15T00:45:53.136ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15852025-01-15T00:45:53.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15862025-01-15T00:45:53.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15872025-01-15T00:45:53.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15882025-01-15T00:45:53.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15892025-01-15T00:45:53.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15902025-01-15T00:45:53.146ZINFOnexus: assigned collector to new producer collector_id = dee7453b-558a-4d94-b6a0-8b27cb27f002 file = nexus/src/app/oximeter.rs:76 producer_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
15912025-01-15T00:45:53.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51568 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:65440 req_id = 9bf00db5-8ecc-4ebd-9e77-0d7e1af71c9d response_code = 201 uri = /metrics/producers
15922025-01-15T00:45:53.146ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9bf00db5-8ecc-4ebd-9e77-0d7e1af71c9d", "content-length": "41", "date": "Wed, 15 Jan 2025 00:45:53 GMT"} })
15932025-01-15T00:45:53.147ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
15942025-01-15T00:45:53.147ZDEBGnexus (producer-registration-task): registered with nexus successfully
15952025-01-15T00:45:53.147ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
15962025-01-15T00:45:53.147ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15972025-01-15T00:45:53.147ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "df2bc14b-03ba-454e-b5b3-de128aef4cc3", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
15982025-01-15T00:45:53.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
15992025-01-15T00:45:53.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b0d57378-9498-4e53-bdbc-283b2ffb160e", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16002025-01-15T00:45:53.149ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16012025-01-15T00:45:53.149ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 542.173864ms iteration = 3 status = {}
16022025-01-15T00:45:53.150ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8e55aef0-6a34-4162-aedd-3706f7caa11e", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16032025-01-15T00:45:53.150ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16042025-01-15T00:45:53.152ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
16052025-01-15T00:45:53.152ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 454.429926ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
16062025-01-15T00:45:53.168ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
16072025-01-15T00:45:53.168ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e23d26c2-acdd-4124-8fe6-8b662811f4cb", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16082025-01-15T00:45:53.168ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16092025-01-15T00:45:53.169ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4c7fc704-7927-479a-b24a-2a9a44002c0f", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16102025-01-15T00:45:53.169ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16112025-01-15T00:45:53.171ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c540b831-2d91-43da-abdf-883e7f877eff", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16122025-01-15T00:45:53.171ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16132025-01-15T00:45:53.173ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
16142025-01-15T00:45:53.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 441.068638ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
16152025-01-15T00:45:53.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16162025-01-15T00:45:53.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16172025-01-15T00:45:53.189ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
16182025-01-15T00:45:53.189ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16192025-01-15T00:45:53.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16202025-01-15T00:45:53.219ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16212025-01-15T00:45:53.220ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fd162b5-f635-46ec-8742-2e3764904643", "content-length": "134", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
16222025-01-15T00:45:53.222ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
16232025-01-15T00:45:53.222ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
16242025-01-15T00:45:53.222ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16252025-01-15T00:45:53.222ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16262025-01-15T00:45:53.222ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16272025-01-15T00:45:53.222ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16282025-01-15T00:45:53.222ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16292025-01-15T00:45:53.222ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16302025-01-15T00:45:53.227ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16312025-01-15T00:45:53.227ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16322025-01-15T00:45:53.227ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
16332025-01-15T00:45:53.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16342025-01-15T00:45:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16352025-01-15T00:45:53.277ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16362025-01-15T00:45:53.277ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed637b5c-a485-4161-ac14-8235fc8093a1", "content-length": "2", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
16372025-01-15T00:45:53.277ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16382025-01-15T00:45:53.277ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d346e59-2fc1-48a0-b28a-6d3d5b5ccc9e", "content-length": "51", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
16392025-01-15T00:45:53.277ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
16402025-01-15T00:45:53.278ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16412025-01-15T00:45:53.380ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "55f10e05-5270-4eff-9595-2c4a22e9e38d", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
16422025-01-15T00:45:53.380ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
16432025-01-15T00:45:53.380ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16442025-01-15T00:45:53.381ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1ea363b-e225-4a30-96d1-b35e8bf3669f", "content-length": "682", "date": "Wed, 15 Jan 2025 00:45:52 GMT"} })
16452025-01-15T00:45:53.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16462025-01-15T00:45:53.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16472025-01-15T00:45:53.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16482025-01-15T00:45:53.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16492025-01-15T00:45:53.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16502025-01-15T00:45:53.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16512025-01-15T00:45:53.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16522025-01-15T00:45:53.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16532025-01-15T00:45:53.404ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 800.257671ms iteration = 3 status = {}
16542025-01-15T00:45:53.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60bd4857-a534-44b9-b536-cc579e2889c0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16552025-01-15T00:45:53.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60bd4857-a534-44b9-b536-cc579e2889c0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16562025-01-15T00:45:53.599ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2125 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60bd4857-a534-44b9-b536-cc579e2889c0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16572025-01-15T00:45:54.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b722c21-32ea-4513-a416-7b8faef42824 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16582025-01-15T00:45:54.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b722c21-32ea-4513-a416-7b8faef42824 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16592025-01-15T00:45:54.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b722c21-32ea-4513-a416-7b8faef42824 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16602025-01-15T00:45:55.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cbf2696a-4b29-429b-b515-410018e34b4d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16612025-01-15T00:45:55.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cbf2696a-4b29-429b-b515-410018e34b4d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16622025-01-15T00:45:55.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2636 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cbf2696a-4b29-429b-b515-410018e34b4d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16632025-01-15T00:45:56.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3dfbd140-de9d-48f4-86e5-7624b37bfc79 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16642025-01-15T00:45:56.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3dfbd140-de9d-48f4-86e5-7624b37bfc79 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16652025-01-15T00:45:56.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3dfbd140-de9d-48f4-86e5-7624b37bfc79 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16662025-01-15T00:45:57.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f36daedc-11db-41c2-a561-84a3963af10e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16672025-01-15T00:45:57.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f36daedc-11db-41c2-a561-84a3963af10e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16682025-01-15T00:45:57.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f36daedc-11db-41c2-a561-84a3963af10e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16692025-01-15T00:45:58.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b39fca02-979e-4001-a40b-36df0660813e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16702025-01-15T00:45:58.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b39fca02-979e-4001-a40b-36df0660813e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16712025-01-15T00:45:58.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b39fca02-979e-4001-a40b-36df0660813e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16722025-01-15T00:45:59.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c7c355fa-cebb-477d-8e5a-aec1b56fe074 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16732025-01-15T00:45:59.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c7c355fa-cebb-477d-8e5a-aec1b56fe074 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16742025-01-15T00:45:59.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1985 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c7c355fa-cebb-477d-8e5a-aec1b56fe074 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16752025-01-15T00:46:00.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4fae7623-a3c9-4931-b7db-f982b54e7161 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16762025-01-15T00:46:00.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4fae7623-a3c9-4931-b7db-f982b54e7161 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16772025-01-15T00:46:00.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4fae7623-a3c9-4931-b7db-f982b54e7161 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16782025-01-15T00:46:01.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1942c459-8cf4-44e7-aa54-53e9bb499216 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16792025-01-15T00:46:01.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1942c459-8cf4-44e7-aa54-53e9bb499216 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16802025-01-15T00:46:01.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2129 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1942c459-8cf4-44e7-aa54-53e9bb499216 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
16812025-01-15T00:46:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
16822025-01-15T00:46:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16832025-01-15T00:46:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16842025-01-15T00:46:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16852025-01-15T00:46:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16862025-01-15T00:46:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16872025-01-15T00:46:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16882025-01-15T00:46:02.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
16892025-01-15T00:46:02.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16902025-01-15T00:46:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16912025-01-15T00:46:02.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16922025-01-15T00:46:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16932025-01-15T00:46:02.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16942025-01-15T00:46:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16952025-01-15T00:46:02.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.582909ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16962025-01-15T00:46:02.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16972025-01-15T00:46:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
16982025-01-15T00:46:02.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16992025-01-15T00:46:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17002025-01-15T00:46:02.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
17012025-01-15T00:46:02.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.468891ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
17022025-01-15T00:46:02.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 675c198e-aeca-456d-a78a-6c0b7b7c270f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17032025-01-15T00:46:02.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 675c198e-aeca-456d-a78a-6c0b7b7c270f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17042025-01-15T00:46:02.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2062 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 675c198e-aeca-456d-a78a-6c0b7b7c270f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17052025-01-15T00:46:03.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c787fc61-4d74-454d-8ef5-3925ee661d0b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17062025-01-15T00:46:03.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c787fc61-4d74-454d-8ef5-3925ee661d0b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17072025-01-15T00:46:03.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c787fc61-4d74-454d-8ef5-3925ee661d0b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17082025-01-15T00:46:04.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d27f3381-0b39-46fb-9bf7-33562936571c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17092025-01-15T00:46:04.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d27f3381-0b39-46fb-9bf7-33562936571c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17102025-01-15T00:46:04.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d27f3381-0b39-46fb-9bf7-33562936571c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17112025-01-15T00:46:05.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8aef1a29-8e68-4ed5-be6c-0ea272e36c37 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17122025-01-15T00:46:05.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8aef1a29-8e68-4ed5-be6c-0ea272e36c37 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17132025-01-15T00:46:05.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8aef1a29-8e68-4ed5-be6c-0ea272e36c37 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17142025-01-15T00:46:06.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cf17ffd1-0654-438e-9c07-e46188094e11 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17152025-01-15T00:46:06.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cf17ffd1-0654-438e-9c07-e46188094e11 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17162025-01-15T00:46:06.876ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cf17ffd1-0654-438e-9c07-e46188094e11 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17172025-01-15T00:46:07.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 370e226f-d760-4aa5-a060-09ec1f9fbd0b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17182025-01-15T00:46:07.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 370e226f-d760-4aa5-a060-09ec1f9fbd0b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17192025-01-15T00:46:07.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 370e226f-d760-4aa5-a060-09ec1f9fbd0b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17202025-01-15T00:46:08.916ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 303deb8c-faf0-419f-9d60-5ce85a5ee689 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17212025-01-15T00:46:08.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 303deb8c-faf0-419f-9d60-5ce85a5ee689 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17222025-01-15T00:46:08.918ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1920 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 303deb8c-faf0-419f-9d60-5ce85a5ee689 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17232025-01-15T00:46:09.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 54e2e6a7-3d65-4fa7-8170-068b71f80448 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17242025-01-15T00:46:09.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 54e2e6a7-3d65-4fa7-8170-068b71f80448 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17252025-01-15T00:46:09.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 54e2e6a7-3d65-4fa7-8170-068b71f80448 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17262025-01-15T00:46:10.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d65e5379-ea81-42b9-8861-69b27d127b5b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17272025-01-15T00:46:10.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d65e5379-ea81-42b9-8861-69b27d127b5b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17282025-01-15T00:46:10.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d65e5379-ea81-42b9-8861-69b27d127b5b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17292025-01-15T00:46:11.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 495ec947-f751-4395-b0bb-f5cea37fa68f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17302025-01-15T00:46:11.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 495ec947-f751-4395-b0bb-f5cea37fa68f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17312025-01-15T00:46:11.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1859 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 495ec947-f751-4395-b0bb-f5cea37fa68f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17322025-01-15T00:46:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
17332025-01-15T00:46:12.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17342025-01-15T00:46:12.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17352025-01-15T00:46:12.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17362025-01-15T00:46:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17372025-01-15T00:46:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382025-01-15T00:46:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392025-01-15T00:46:12.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
17402025-01-15T00:46:12.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17412025-01-15T00:46:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17422025-01-15T00:46:12.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17432025-01-15T00:46:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17442025-01-15T00:46:12.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17452025-01-15T00:46:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17462025-01-15T00:46:12.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.854443ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17472025-01-15T00:46:12.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17482025-01-15T00:46:12.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
17492025-01-15T00:46:12.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17502025-01-15T00:46:12.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17512025-01-15T00:46:12.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
17522025-01-15T00:46:12.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.101465ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
17532025-01-15T00:46:13.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 125d230d-78ee-4dcb-b7d4-58878b776175 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17542025-01-15T00:46:13.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 125d230d-78ee-4dcb-b7d4-58878b776175 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17552025-01-15T00:46:13.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2445 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 125d230d-78ee-4dcb-b7d4-58878b776175 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17562025-01-15T00:46:14.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 02d81c52-795b-4411-9438-31424c47ec8a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17572025-01-15T00:46:14.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 02d81c52-795b-4411-9438-31424c47ec8a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17582025-01-15T00:46:14.025ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 02d81c52-795b-4411-9438-31424c47ec8a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17592025-01-15T00:46:14.291ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:51350 remote_addr = [fd00:1122:3344:101::d]:42560
17602025-01-15T00:46:14.298ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7337 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 92490892-3773-474c-bf0a-386eb7c9ff0a response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
17612025-01-15T00:46:15.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 21ff3bbf-4eef-46be-87ae-e48345950aff roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17622025-01-15T00:46:15.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 21ff3bbf-4eef-46be-87ae-e48345950aff resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17632025-01-15T00:46:15.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 21ff3bbf-4eef-46be-87ae-e48345950aff response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17642025-01-15T00:46:16.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a685d89f-7d7c-4ec8-bd41-ce91c80b35d6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17652025-01-15T00:46:16.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a685d89f-7d7c-4ec8-bd41-ce91c80b35d6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17662025-01-15T00:46:16.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4328 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a685d89f-7d7c-4ec8-bd41-ce91c80b35d6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17672025-01-15T00:46:17.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80dfecff-189a-4664-b1c0-757d7286d00d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17682025-01-15T00:46:17.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80dfecff-189a-4664-b1c0-757d7286d00d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17692025-01-15T00:46:17.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80dfecff-189a-4664-b1c0-757d7286d00d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17702025-01-15T00:46:18.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9a3ddd9-8c79-4f80-a087-236d8b11da1c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17712025-01-15T00:46:18.114ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9a3ddd9-8c79-4f80-a087-236d8b11da1c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17722025-01-15T00:46:18.116ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2790 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9a3ddd9-8c79-4f80-a087-236d8b11da1c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17732025-01-15T00:46:19.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 691cbc86-b3fd-46c0-8e71-522636468d13 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17742025-01-15T00:46:19.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 691cbc86-b3fd-46c0-8e71-522636468d13 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17752025-01-15T00:46:19.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1939 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 691cbc86-b3fd-46c0-8e71-522636468d13 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17762025-01-15T00:46:20.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5dae8e6-4cf3-4cdb-9d2e-3333b40fab00 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17772025-01-15T00:46:20.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5dae8e6-4cf3-4cdb-9d2e-3333b40fab00 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17782025-01-15T00:46:20.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2187 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5dae8e6-4cf3-4cdb-9d2e-3333b40fab00 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17792025-01-15T00:46:21.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 416ed0b2-aede-49d1-ab4c-4d9b93718f94 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17802025-01-15T00:46:21.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 416ed0b2-aede-49d1-ab4c-4d9b93718f94 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17812025-01-15T00:46:21.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 416ed0b2-aede-49d1-ab4c-4d9b93718f94 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17822025-01-15T00:46:22.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6d6fabe-ad5c-4494-b90d-ff55ad44105b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17832025-01-15T00:46:22.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6d6fabe-ad5c-4494-b90d-ff55ad44105b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17842025-01-15T00:46:22.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6d6fabe-ad5c-4494-b90d-ff55ad44105b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
17852025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
17862025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
17872025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
17882025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17892025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17902025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
17912025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17922025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17932025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17942025-01-15T00:46:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
17952025-01-15T00:46:22.604ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.693323ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17962025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
17972025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
17982025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
17992025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18002025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18012025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 4 reason = Timeout
18022025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18032025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18042025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18052025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18062025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18072025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18082025-01-15T00:46:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18092025-01-15T00:46:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1002, tv_nsec: 936208058 } })
18102025-01-15T00:46:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
18112025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18122025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18132025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
18142025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18152025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18162025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
18172025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
18182025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18192025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18202025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
18212025-01-15T00:46:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18222025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18232025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
18242025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
18252025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18262025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18272025-01-15T00:46:22.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1002, tv_nsec: 937542713 } })
18282025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18292025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18302025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18312025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18322025-01-15T00:46:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18332025-01-15T00:46:22.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
18342025-01-15T00:46:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18352025-01-15T00:46:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18362025-01-15T00:46:22.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18372025-01-15T00:46:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18382025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
18392025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
18402025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18412025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
18422025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18432025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
18442025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
18452025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18462025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18472025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18482025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
18492025-01-15T00:46:22.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18502025-01-15T00:46:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
18512025-01-15T00:46:22.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18522025-01-15T00:46:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18532025-01-15T00:46:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18542025-01-15T00:46:22.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18552025-01-15T00:46:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18562025-01-15T00:46:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18572025-01-15T00:46:22.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18582025-01-15T00:46:22.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18592025-01-15T00:46:22.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18602025-01-15T00:46:22.611ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18612025-01-15T00:46:22.611ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
18622025-01-15T00:46:22.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18632025-01-15T00:46:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18642025-01-15T00:46:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18652025-01-15T00:46:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
18662025-01-15T00:46:22.612ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18672025-01-15T00:46:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18682025-01-15T00:46:22.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18692025-01-15T00:46:22.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18702025-01-15T00:46:22.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18712025-01-15T00:46:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18722025-01-15T00:46:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
18732025-01-15T00:46:22.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18742025-01-15T00:46:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18752025-01-15T00:46:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18762025-01-15T00:46:22.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18772025-01-15T00:46:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18782025-01-15T00:46:22.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18792025-01-15T00:46:22.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18802025-01-15T00:46:22.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.804439ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
18812025-01-15T00:46:22.619ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18822025-01-15T00:46:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18832025-01-15T00:46:22.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18842025-01-15T00:46:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18852025-01-15T00:46:22.620ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1002, tv_nsec: 950270729 } })
18862025-01-15T00:46:22.620ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
18872025-01-15T00:46:22.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18882025-01-15T00:46:22.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18892025-01-15T00:46:22.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18902025-01-15T00:46:22.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18912025-01-15T00:46:22.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18922025-01-15T00:46:22.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18932025-01-15T00:46:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18942025-01-15T00:46:22.625ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18952025-01-15T00:46:22.625ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18962025-01-15T00:46:22.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18972025-01-15T00:46:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18982025-01-15T00:46:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
18992025-01-15T00:46:22.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19002025-01-15T00:46:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19012025-01-15T00:46:22.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19022025-01-15T00:46:22.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19032025-01-15T00:46:22.633ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
19042025-01-15T00:46:22.633ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 25.591473ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
19052025-01-15T00:46:22.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19062025-01-15T00:46:22.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19072025-01-15T00:46:22.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19082025-01-15T00:46:22.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19092025-01-15T00:46:22.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19102025-01-15T00:46:22.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 39.454269ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
19112025-01-15T00:46:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
19122025-01-15T00:46:22.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19132025-01-15T00:46:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19142025-01-15T00:46:22.653ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19152025-01-15T00:46:22.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19162025-01-15T00:46:22.654ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.922471ms iteration = 4 status = 0
19172025-01-15T00:46:22.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.30256ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19182025-01-15T00:46:22.659ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19192025-01-15T00:46:22.659ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19202025-01-15T00:46:22.659ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 52.158794ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19212025-01-15T00:46:22.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 52.162954ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19222025-01-15T00:46:22.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19232025-01-15T00:46:22.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19242025-01-15T00:46:22.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19252025-01-15T00:46:22.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19262025-01-15T00:46:22.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 54.774044ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
19272025-01-15T00:46:22.669ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19282025-01-15T00:46:22.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19292025-01-15T00:46:22.671ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19302025-01-15T00:46:22.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19312025-01-15T00:46:22.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.673776ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
19322025-01-15T00:46:22.676ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
19332025-01-15T00:46:22.676ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19342025-01-15T00:46:22.676ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4df7aeba-7eda-4d69-acd9-1cf1b3112f59", "content-length": "26", "date": "Wed, 15 Jan 2025 00:46:21 GMT"} })
19352025-01-15T00:46:22.676ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19362025-01-15T00:46:22.678ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19372025-01-15T00:46:22.688ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
19382025-01-15T00:46:22.688ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19392025-01-15T00:46:22.689ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e931ce4-e2f0-4abf-abfb-a0ad8076de6c", "content-length": "26", "date": "Wed, 15 Jan 2025 00:46:21 GMT"} })
19402025-01-15T00:46:22.689ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19412025-01-15T00:46:22.690ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19422025-01-15T00:46:22.704ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
19432025-01-15T00:46:22.704ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19442025-01-15T00:46:22.704ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a59755f-ff6e-4667-8a1c-522ce044b696", "content-length": "26", "date": "Wed, 15 Jan 2025 00:46:21 GMT"} })
19452025-01-15T00:46:22.704ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19462025-01-15T00:46:22.706ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
19472025-01-15T00:46:22.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19482025-01-15T00:46:22.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19492025-01-15T00:46:22.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19502025-01-15T00:46:22.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19512025-01-15T00:46:22.744ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19522025-01-15T00:46:22.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19532025-01-15T00:46:22.746ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542025-01-15T00:46:22.748ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
19552025-01-15T00:46:22.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19562025-01-15T00:46:22.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19572025-01-15T00:46:22.757ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
19582025-01-15T00:46:22.757ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 154.291459ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
19592025-01-15T00:46:22.766ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19602025-01-15T00:46:22.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19612025-01-15T00:46:22.768ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19622025-01-15T00:46:22.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19632025-01-15T00:46:22.770ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19642025-01-15T00:46:22.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19652025-01-15T00:46:22.775ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.164353ms iteration = 4 status = {}
19662025-01-15T00:46:22.806ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
19672025-01-15T00:46:22.806ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 201.61781ms iteration = 4 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
19682025-01-15T00:46:22.857ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19692025-01-15T00:46:22.857ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cbf409e-dae3-4c4e-a8c8-6fa0186f0223", "content-length": "1", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
19702025-01-15T00:46:22.859ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19712025-01-15T00:46:22.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19722025-01-15T00:46:22.878ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 272.862831ms iteration = 6 status = {"physical_disks_added":0}
19732025-01-15T00:46:22.899ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
19742025-01-15T00:46:22.899ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4ba3ce0-1241-44f5-9fb0-d9a6d6c78b54", "content-length": "691", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
19752025-01-15T00:46:22.899ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
19762025-01-15T00:46:22.899ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
19772025-01-15T00:46:22.899ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
19782025-01-15T00:46:22.900ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 297.458415ms iteration = 4 status = null
19792025-01-15T00:46:22.901ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 293.703232ms iteration = 4 status = {}
19802025-01-15T00:46:22.945ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
19812025-01-15T00:46:22.945ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19822025-01-15T00:46:22.945ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0635335-0f68-42cc-9eb9-8dddde78b46b", "content-length": "372", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
19832025-01-15T00:46:22.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19842025-01-15T00:46:22.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19852025-01-15T00:46:22.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19862025-01-15T00:46:22.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19872025-01-15T00:46:22.974ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
19882025-01-15T00:46:22.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19892025-01-15T00:46:22.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19902025-01-15T00:46:22.991ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
19912025-01-15T00:46:22.991ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
19922025-01-15T00:46:22.991ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1f811928-81b1-45db-a4c6-2c257a0fb737", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
19932025-01-15T00:46:22.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19942025-01-15T00:46:22.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19952025-01-15T00:46:22.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19962025-01-15T00:46:22.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19972025-01-15T00:46:22.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19982025-01-15T00:46:22.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19992025-01-15T00:46:23.000ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
20002025-01-15T00:46:23.000ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
20012025-01-15T00:46:23.000ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "965fae7f-2116-4107-a0d1-2f2ca046d58b", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
20022025-01-15T00:46:23.001ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 394.423291ms iteration = 4 status = {}
20032025-01-15T00:46:23.102ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
20042025-01-15T00:46:23.102ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6183a8ed-dad4-4a05-bea5-4dc69a78241d", "content-length": "134", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
20052025-01-15T00:46:23.102ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
20062025-01-15T00:46:23.102ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
20072025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
20082025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
20092025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20102025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20112025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20122025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20132025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
20142025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
20152025-01-15T00:46:23.103ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
20162025-01-15T00:46:23.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20172025-01-15T00:46:23.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20182025-01-15T00:46:23.105ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
20192025-01-15T00:46:23.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "afd65da7-bdd8-4e75-8782-ae9232cb8020", "content-length": "2", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
20202025-01-15T00:46:23.105ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
20212025-01-15T00:46:23.105ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbd725ac-7fa3-4827-8a42-17e6a860f1ea", "content-length": "51", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
20222025-01-15T00:46:23.105ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
20232025-01-15T00:46:23.105ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
20242025-01-15T00:46:23.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c4f01ec2-478a-4d41-836a-88fac94022e8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
20252025-01-15T00:46:23.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c4f01ec2-478a-4d41-836a-88fac94022e8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
20262025-01-15T00:46:23.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c4f01ec2-478a-4d41-836a-88fac94022e8 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
20272025-01-15T00:46:23.199ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5c18bb24-5733-4cca-8232-d0496f8cde10", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
20282025-01-15T00:46:23.199ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
20292025-01-15T00:46:23.199ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
20302025-01-15T00:46:23.199ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "342f314f-f337-45f0-b9d0-0e6c8c200458", "content-length": "682", "date": "Wed, 15 Jan 2025 00:46:22 GMT"} })
20312025-01-15T00:46:23.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20322025-01-15T00:46:23.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20332025-01-15T00:46:23.203ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20342025-01-15T00:46:23.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20352025-01-15T00:46:23.207ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20362025-01-15T00:46:23.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20372025-01-15T00:46:23.209ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20382025-01-15T00:46:23.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20392025-01-15T00:46:23.214ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 609.548821ms iteration = 4 status = {}
20402025-01-15T00:46:23.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8fb92b59-d849-43df-a2b4-6c47b04db332 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20412025-01-15T00:46:23.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8fb92b59-d849-43df-a2b4-6c47b04db332 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20422025-01-15T00:46:23.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8fb92b59-d849-43df-a2b4-6c47b04db332 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20432025-01-15T00:46:24.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d3ca07f0-f73f-49b1-8168-bbaea79537d5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20442025-01-15T00:46:24.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d3ca07f0-f73f-49b1-8168-bbaea79537d5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20452025-01-15T00:46:24.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d3ca07f0-f73f-49b1-8168-bbaea79537d5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20462025-01-15T00:46:24.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 639 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 6807de4f-1b4f-4d9b-8392-876f1da8835a response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
20472025-01-15T00:46:25.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e3915b1-5ed3-45de-98e2-1198308a5375 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20482025-01-15T00:46:25.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e3915b1-5ed3-45de-98e2-1198308a5375 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20492025-01-15T00:46:25.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e3915b1-5ed3-45de-98e2-1198308a5375 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20502025-01-15T00:46:26.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 344c7f8e-8a38-4ccd-b10b-470c96100b37 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20512025-01-15T00:46:26.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 344c7f8e-8a38-4ccd-b10b-470c96100b37 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20522025-01-15T00:46:26.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 344c7f8e-8a38-4ccd-b10b-470c96100b37 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20532025-01-15T00:46:27.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3f4cdb70-2dbc-4ae7-a74d-fb5fe2ba777d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20542025-01-15T00:46:27.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3f4cdb70-2dbc-4ae7-a74d-fb5fe2ba777d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20552025-01-15T00:46:27.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3f4cdb70-2dbc-4ae7-a74d-fb5fe2ba777d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20562025-01-15T00:46:28.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e4bfd8cd-99b6-4ba1-a008-58e21020143a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20572025-01-15T00:46:28.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e4bfd8cd-99b6-4ba1-a008-58e21020143a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20582025-01-15T00:46:28.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e4bfd8cd-99b6-4ba1-a008-58e21020143a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20592025-01-15T00:46:29.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4be8349c-446a-4f71-864b-2987c82af7ae roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20602025-01-15T00:46:29.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4be8349c-446a-4f71-864b-2987c82af7ae resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20612025-01-15T00:46:29.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4be8349c-446a-4f71-864b-2987c82af7ae response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20622025-01-15T00:46:30.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e99ccb8b-318b-44b3-83ac-53aca230d8ad roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20632025-01-15T00:46:30.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e99ccb8b-318b-44b3-83ac-53aca230d8ad resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20642025-01-15T00:46:30.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e99ccb8b-318b-44b3-83ac-53aca230d8ad response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20652025-01-15T00:46:31.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2406be7a-5a92-4199-ba6c-1dca9e0e4d47 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20662025-01-15T00:46:31.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2406be7a-5a92-4199-ba6c-1dca9e0e4d47 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20672025-01-15T00:46:31.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2524 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2406be7a-5a92-4199-ba6c-1dca9e0e4d47 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20682025-01-15T00:46:32.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b2ac189-faab-4bea-8419-9e1a9b899270 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20692025-01-15T00:46:32.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b2ac189-faab-4bea-8419-9e1a9b899270 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20702025-01-15T00:46:32.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2281 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b2ac189-faab-4bea-8419-9e1a9b899270 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20712025-01-15T00:46:32.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
20722025-01-15T00:46:32.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20732025-01-15T00:46:32.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20742025-01-15T00:46:32.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20752025-01-15T00:46:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20762025-01-15T00:46:32.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20772025-01-15T00:46:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20782025-01-15T00:46:32.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
20792025-01-15T00:46:32.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20802025-01-15T00:46:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20812025-01-15T00:46:32.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20822025-01-15T00:46:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20832025-01-15T00:46:32.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20842025-01-15T00:46:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
20852025-01-15T00:46:32.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20862025-01-15T00:46:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20872025-01-15T00:46:32.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
20882025-01-15T00:46:32.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.401571ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
20892025-01-15T00:46:32.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20902025-01-15T00:46:32.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20912025-01-15T00:46:32.644ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.88939ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20922025-01-15T00:46:33.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e28282d-69b5-4e0a-9c4b-1a61fa0905bd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20932025-01-15T00:46:33.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e28282d-69b5-4e0a-9c4b-1a61fa0905bd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20942025-01-15T00:46:33.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e28282d-69b5-4e0a-9c4b-1a61fa0905bd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20952025-01-15T00:46:34.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 905 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 0902a9d3-1410-4882-a435-40a669b4738c response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
20962025-01-15T00:46:34.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c1ac9dfb-997c-4e9f-9209-b6a9d8f447e3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20972025-01-15T00:46:34.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c1ac9dfb-997c-4e9f-9209-b6a9d8f447e3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20982025-01-15T00:46:34.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1765 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c1ac9dfb-997c-4e9f-9209-b6a9d8f447e3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
20992025-01-15T00:46:35.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d6ed08dd-0a3f-4479-80e8-8a726a4412e6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21002025-01-15T00:46:35.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d6ed08dd-0a3f-4479-80e8-8a726a4412e6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21012025-01-15T00:46:35.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d6ed08dd-0a3f-4479-80e8-8a726a4412e6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21022025-01-15T00:46:36.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b127cac-77d0-4331-bdfc-d929e532356c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21032025-01-15T00:46:36.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b127cac-77d0-4331-bdfc-d929e532356c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21042025-01-15T00:46:36.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b127cac-77d0-4331-bdfc-d929e532356c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21052025-01-15T00:46:37.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0b10f390-c0ee-4be7-825a-71bf10c57998 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21062025-01-15T00:46:37.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0b10f390-c0ee-4be7-825a-71bf10c57998 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21072025-01-15T00:46:37.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2888 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0b10f390-c0ee-4be7-825a-71bf10c57998 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21082025-01-15T00:46:38.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0fbea3e-35e8-45f5-bd4f-799156d987f4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21092025-01-15T00:46:38.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0fbea3e-35e8-45f5-bd4f-799156d987f4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21102025-01-15T00:46:38.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0fbea3e-35e8-45f5-bd4f-799156d987f4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21112025-01-15T00:46:39.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b247353-98e0-48ed-bdd6-7f50623f4de9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21122025-01-15T00:46:39.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b247353-98e0-48ed-bdd6-7f50623f4de9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21132025-01-15T00:46:39.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1875 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b247353-98e0-48ed-bdd6-7f50623f4de9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21142025-01-15T00:46:40.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = db6f393a-55c0-4a0e-8c17-5324b421ce87 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21152025-01-15T00:46:40.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = db6f393a-55c0-4a0e-8c17-5324b421ce87 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21162025-01-15T00:46:40.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2304 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = db6f393a-55c0-4a0e-8c17-5324b421ce87 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21172025-01-15T00:46:41.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 033ee8f0-3302-4450-a4ac-f1b4b7c34e17 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21182025-01-15T00:46:41.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 033ee8f0-3302-4450-a4ac-f1b4b7c34e17 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21192025-01-15T00:46:41.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 033ee8f0-3302-4450-a4ac-f1b4b7c34e17 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21202025-01-15T00:46:42.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
21212025-01-15T00:46:42.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21222025-01-15T00:46:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21232025-01-15T00:46:42.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21242025-01-15T00:46:42.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
21252025-01-15T00:46:42.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21262025-01-15T00:46:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21272025-01-15T00:46:42.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
21282025-01-15T00:46:42.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21292025-01-15T00:46:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21302025-01-15T00:46:42.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21312025-01-15T00:46:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21322025-01-15T00:46:42.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21332025-01-15T00:46:42.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
21342025-01-15T00:46:42.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
21352025-01-15T00:46:42.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.261043ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21362025-01-15T00:46:42.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
21372025-01-15T00:46:42.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21382025-01-15T00:46:42.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
21392025-01-15T00:46:42.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbd34150-1167-449b-9f22-ed2595bd920b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21402025-01-15T00:46:42.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbd34150-1167-449b-9f22-ed2595bd920b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21412025-01-15T00:46:42.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbd34150-1167-449b-9f22-ed2595bd920b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21422025-01-15T00:46:42.840ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
21432025-01-15T00:46:42.840ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 237.947319ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
21442025-01-15T00:46:43.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eb3a7f76-ac76-4095-a16d-1f098d877c47 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21452025-01-15T00:46:43.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eb3a7f76-ac76-4095-a16d-1f098d877c47 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21462025-01-15T00:46:43.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1695 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eb3a7f76-ac76-4095-a16d-1f098d877c47 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21472025-01-15T00:46:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 569 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = a54ff6b5-4491-45da-8dc0-0285da61a57f response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
21482025-01-15T00:46:44.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 44a41f6c-54eb-4aeb-9316-c0c4dd07ad98 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21492025-01-15T00:46:44.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 44a41f6c-54eb-4aeb-9316-c0c4dd07ad98 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21502025-01-15T00:46:44.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 44a41f6c-54eb-4aeb-9316-c0c4dd07ad98 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21512025-01-15T00:46:45.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ee41382f-2e86-471d-b5f8-c3933a1cb1f5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21522025-01-15T00:46:45.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ee41382f-2e86-471d-b5f8-c3933a1cb1f5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21532025-01-15T00:46:45.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ee41382f-2e86-471d-b5f8-c3933a1cb1f5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21542025-01-15T00:46:46.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c73b4a66-f00f-40c4-a15e-70c2e8117b6c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21552025-01-15T00:46:46.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c73b4a66-f00f-40c4-a15e-70c2e8117b6c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21562025-01-15T00:46:46.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c73b4a66-f00f-40c4-a15e-70c2e8117b6c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21572025-01-15T00:46:47.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de63682a-8b96-4f6b-9498-83b7b4522291 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21582025-01-15T00:46:47.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de63682a-8b96-4f6b-9498-83b7b4522291 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21592025-01-15T00:46:47.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de63682a-8b96-4f6b-9498-83b7b4522291 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21602025-01-15T00:46:48.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b477c735-a803-4438-8a40-2f79b53e5c9b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21612025-01-15T00:46:48.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b477c735-a803-4438-8a40-2f79b53e5c9b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21622025-01-15T00:46:48.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b477c735-a803-4438-8a40-2f79b53e5c9b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21632025-01-15T00:46:49.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 84ead65b-9e55-4dd5-81fc-1e01e1cf5447 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21642025-01-15T00:46:49.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 84ead65b-9e55-4dd5-81fc-1e01e1cf5447 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21652025-01-15T00:46:49.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 84ead65b-9e55-4dd5-81fc-1e01e1cf5447 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21662025-01-15T00:46:50.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0f06cc44-fd96-4515-a706-c2cd61258454 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21672025-01-15T00:46:50.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0f06cc44-fd96-4515-a706-c2cd61258454 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21682025-01-15T00:46:50.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2386 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0f06cc44-fd96-4515-a706-c2cd61258454 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21692025-01-15T00:46:51.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7610eef1-0504-4a97-9de3-d7b68605eddc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21702025-01-15T00:46:51.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7610eef1-0504-4a97-9de3-d7b68605eddc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21712025-01-15T00:46:51.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7610eef1-0504-4a97-9de3-d7b68605eddc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
21722025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
21732025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
21742025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21752025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
21762025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
21772025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
21782025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
21792025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
21802025-01-15T00:46:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
21812025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
21822025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.481\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
21832025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
21842025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
21852025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
21862025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
21872025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
21882025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21892025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
21902025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
21912025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
21922025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
21932025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
21942025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
21952025-01-15T00:46:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:36:52.603176529 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
21962025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
21972025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
21982025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21992025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22002025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
22012025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22022025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
22032025-01-15T00:46:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22042025-01-15T00:46:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1032, tv_nsec: 933491206 } })
22052025-01-15T00:46:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1032, tv_nsec: 933542427 } })
22062025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22072025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.08872ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22082025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
22092025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.195323ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
22102025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
22112025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22122025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
22132025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22142025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
22152025-01-15T00:46:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
22162025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22172025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
22182025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
22192025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
22202025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
22212025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22222025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22232025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
22242025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22252025-01-15T00:46:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
22262025-01-15T00:46:52.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22272025-01-15T00:46:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22282025-01-15T00:46:52.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22292025-01-15T00:46:52.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22302025-01-15T00:46:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22312025-01-15T00:46:52.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.484467ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
22322025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
22332025-01-15T00:46:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
22342025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
22352025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22362025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
22372025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
22382025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
22392025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
22402025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
22412025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
22422025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
22432025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22442025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
22452025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
22462025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
22472025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
22482025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22492025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22502025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
22512025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
22522025-01-15T00:46:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1032, tv_nsec: 937632795 } })
22532025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22542025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
22552025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
22562025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22572025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22582025-01-15T00:46:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
22592025-01-15T00:46:52.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22602025-01-15T00:46:52.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
22612025-01-15T00:46:52.610ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:36:52.603176529 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
22622025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.993834ms iteration = 3 status = {"expiration":"2025-01-15T00:36:52.603176529Z","pruned":[]}
22632025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
22642025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
22652025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
22662025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
22672025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
22682025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
22692025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
22702025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
22712025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
22722025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
22732025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
22742025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
22752025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22762025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22772025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
22782025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
22792025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
22802025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
22812025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
22822025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
22832025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22842025-01-15T00:46:52.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22852025-01-15T00:46:52.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22862025-01-15T00:46:52.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22872025-01-15T00:46:52.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22882025-01-15T00:46:52.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22892025-01-15T00:46:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
22902025-01-15T00:46:52.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
22912025-01-15T00:46:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
22922025-01-15T00:46:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
22932025-01-15T00:46:52.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
22942025-01-15T00:46:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
22952025-01-15T00:46:52.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22962025-01-15T00:46:52.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22972025-01-15T00:46:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
22982025-01-15T00:46:52.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22992025-01-15T00:46:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23002025-01-15T00:46:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
23012025-01-15T00:46:52.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23022025-01-15T00:46:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23032025-01-15T00:46:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
23042025-01-15T00:46:52.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23052025-01-15T00:46:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23062025-01-15T00:46:52.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23072025-01-15T00:46:52.619ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
23082025-01-15T00:46:52.619ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
23092025-01-15T00:46:52.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23102025-01-15T00:46:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23112025-01-15T00:46:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
23122025-01-15T00:46:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23132025-01-15T00:46:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23142025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23152025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23162025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23172025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23182025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23192025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23202025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23212025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23222025-01-15T00:46:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23232025-01-15T00:46:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23242025-01-15T00:46:52.621ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23252025-01-15T00:46:52.622ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23262025-01-15T00:46:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23272025-01-15T00:46:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
23282025-01-15T00:46:52.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
23292025-01-15T00:46:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
23302025-01-15T00:46:52.635ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 24.824108ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
23312025-01-15T00:46:52.640ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 29.799134ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
23322025-01-15T00:46:52.640ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1032, tv_nsec: 970362895 } })
23332025-01-15T00:46:52.640ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
23342025-01-15T00:46:52.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23352025-01-15T00:46:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23362025-01-15T00:46:52.648ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23372025-01-15T00:46:52.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
23382025-01-15T00:46:52.649ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1032, tv_nsec: 979295327 } })
23392025-01-15T00:46:52.649ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
23402025-01-15T00:46:52.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23412025-01-15T00:46:52.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23422025-01-15T00:46:52.652ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432025-01-15T00:46:52.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23442025-01-15T00:46:52.656ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23452025-01-15T00:46:52.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23462025-01-15T00:46:52.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23472025-01-15T00:46:52.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
23482025-01-15T00:46:52.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23492025-01-15T00:46:52.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
23502025-01-15T00:46:52.671ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23512025-01-15T00:46:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
23522025-01-15T00:46:52.682ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23532025-01-15T00:46:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23542025-01-15T00:46:52.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 77.90351ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23552025-01-15T00:46:52.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23562025-01-15T00:46:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23572025-01-15T00:46:52.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23582025-01-15T00:46:52.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.819036ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
23592025-01-15T00:46:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
23602025-01-15T00:46:52.692ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23612025-01-15T00:46:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
23622025-01-15T00:46:52.693ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23632025-01-15T00:46:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23642025-01-15T00:46:52.693ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
23652025-01-15T00:46:52.693ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
23662025-01-15T00:46:52.693ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.440677ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
23672025-01-15T00:46:52.694ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.986981ms iteration = 5 status = 0
23682025-01-15T00:46:52.694ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
23692025-01-15T00:46:52.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
23702025-01-15T00:46:52.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 86.023255ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
23712025-01-15T00:46:52.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.476632ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23722025-01-15T00:46:52.697ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
23732025-01-15T00:46:52.697ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
23742025-01-15T00:46:52.697ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.262685ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
23752025-01-15T00:46:52.699ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23762025-01-15T00:46:52.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23772025-01-15T00:46:52.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
23782025-01-15T00:46:52.701ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
23792025-01-15T00:46:52.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
23802025-01-15T00:46:52.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23812025-01-15T00:46:52.702ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23822025-01-15T00:46:52.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23832025-01-15T00:46:52.703ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
23842025-01-15T00:46:52.703ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 98.921294ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
23852025-01-15T00:46:52.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23862025-01-15T00:46:52.704ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23872025-01-15T00:46:52.706ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
23882025-01-15T00:46:52.706ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 99.195729ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
23892025-01-15T00:46:52.707ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23902025-01-15T00:46:52.707ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23912025-01-15T00:46:52.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23922025-01-15T00:46:52.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
23932025-01-15T00:46:52.708ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23942025-01-15T00:46:52.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23952025-01-15T00:46:52.709ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23962025-01-15T00:46:52.710ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23972025-01-15T00:46:52.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
23982025-01-15T00:46:52.711ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23992025-01-15T00:46:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24002025-01-15T00:46:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24012025-01-15T00:46:52.711ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24022025-01-15T00:46:52.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
24032025-01-15T00:46:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24042025-01-15T00:46:52.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24052025-01-15T00:46:52.712ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24062025-01-15T00:46:52.712ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
24072025-01-15T00:46:52.712ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24082025-01-15T00:46:52.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24092025-01-15T00:46:52.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24102025-01-15T00:46:52.712ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24112025-01-15T00:46:52.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24122025-01-15T00:46:52.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24132025-01-15T00:46:52.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
24142025-01-15T00:46:52.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24152025-01-15T00:46:52.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24162025-01-15T00:46:52.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24172025-01-15T00:46:52.721ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24182025-01-15T00:46:52.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
24192025-01-15T00:46:52.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24202025-01-15T00:46:52.747ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
24212025-01-15T00:46:52.747ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
24222025-01-15T00:46:52.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24232025-01-15T00:46:52.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24242025-01-15T00:46:52.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24252025-01-15T00:46:52.749ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
24262025-01-15T00:46:52.749ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
24272025-01-15T00:46:52.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24282025-01-15T00:46:52.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24292025-01-15T00:46:52.751ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.939792ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
24302025-01-15T00:46:52.751ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24312025-01-15T00:46:52.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
24322025-01-15T00:46:52.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
24332025-01-15T00:46:52.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24342025-01-15T00:46:52.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24352025-01-15T00:46:52.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24362025-01-15T00:46:52.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24372025-01-15T00:46:52.756ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24382025-01-15T00:46:52.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24392025-01-15T00:46:52.756ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
24402025-01-15T00:46:52.756ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24412025-01-15T00:46:52.756ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
24422025-01-15T00:46:52.756ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 153.688537ms iteration = 3 status = {"generation":2}
24432025-01-15T00:46:52.759ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24442025-01-15T00:46:52.759ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
24452025-01-15T00:46:52.759ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 151.635818ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
24462025-01-15T00:46:52.823ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
24472025-01-15T00:46:52.823ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 220.302439ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
24482025-01-15T00:46:52.832ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
24492025-01-15T00:46:52.832ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 229.028658ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
24502025-01-15T00:46:52.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
24512025-01-15T00:46:52.835ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24522025-01-15T00:46:52.835ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f5aa1a0-a3c6-4290-a529-453cc255e1b9", "content-length": "26", "date": "Wed, 15 Jan 2025 00:46:51 GMT"} })
24532025-01-15T00:46:52.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24542025-01-15T00:46:52.837ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
24552025-01-15T00:46:52.837ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 229.622639ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
24562025-01-15T00:46:52.838ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
24572025-01-15T00:46:52.854ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
24582025-01-15T00:46:52.854ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
24592025-01-15T00:46:52.854ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
24602025-01-15T00:46:52.854ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 250.979961ms iteration = 3 status = {"generation":1}
24612025-01-15T00:46:52.859ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24622025-01-15T00:46:52.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24632025-01-15T00:46:52.860ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642025-01-15T00:46:52.862ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24652025-01-15T00:46:52.862ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24662025-01-15T00:46:52.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24672025-01-15T00:46:52.864ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24682025-01-15T00:46:52.866ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
24692025-01-15T00:46:52.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
24702025-01-15T00:46:52.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24712025-01-15T00:46:52.895ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
24722025-01-15T00:46:52.895ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24732025-01-15T00:46:52.895ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47ae6387-09f2-4b10-91bb-9d7d5dc3b754", "content-length": "26", "date": "Wed, 15 Jan 2025 00:46:51 GMT"} })
24742025-01-15T00:46:52.896ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24752025-01-15T00:46:52.897ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24762025-01-15T00:46:52.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ecc44de9-a6b3-4937-9b59-bb83d3ca0889 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
24772025-01-15T00:46:52.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ecc44de9-a6b3-4937-9b59-bb83d3ca0889 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
24782025-01-15T00:46:52.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2732 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ecc44de9-a6b3-4937-9b59-bb83d3ca0889 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
24792025-01-15T00:46:52.914ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 309.666809ms iteration = 7 status = {"physical_disks_added":0}
24802025-01-15T00:46:52.918ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
24812025-01-15T00:46:52.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
24822025-01-15T00:46:52.944ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
24832025-01-15T00:46:52.944ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d778362-32d1-4741-919a-6f45a3a12ae8", "content-length": "26", "date": "Wed, 15 Jan 2025 00:46:51 GMT"} })
24842025-01-15T00:46:52.944ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
24852025-01-15T00:46:52.946ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
24862025-01-15T00:46:52.946ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24872025-01-15T00:46:52.964ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24882025-01-15T00:46:52.964ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24892025-01-15T00:46:52.964ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "61efabb9-2374-4306-98f1-3cafa0ec73eb", "content-length": "372", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
24902025-01-15T00:46:52.964ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24912025-01-15T00:46:52.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24922025-01-15T00:46:53.094ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
24932025-01-15T00:46:53.094ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1590eaa3-b46b-4450-acab-ebb4441e8e3e", "content-length": "1", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
24942025-01-15T00:46:53.096ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24952025-01-15T00:46:53.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24962025-01-15T00:46:53.098ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 495.738721ms iteration = 5 status = null
24972025-01-15T00:46:53.107ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24982025-01-15T00:46:53.107ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "860c4bb1-8fbe-4dbb-9f5b-4688259c7ec6", "content-length": "691", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
24992025-01-15T00:46:53.107ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
25002025-01-15T00:46:53.107ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
25012025-01-15T00:46:53.107ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
25022025-01-15T00:46:53.109ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 501.590894ms iteration = 5 status = {}
25032025-01-15T00:46:53.118ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 515.281316ms iteration = 5 status = {}
25042025-01-15T00:46:53.120ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25052025-01-15T00:46:53.120ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "c79ec1ee-6c4c-4295-af7f-a6023a1b9b89", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25062025-01-15T00:46:53.120ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25072025-01-15T00:46:53.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2a35b87c-9a4c-40e3-a894-a6ff3222ef46", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25082025-01-15T00:46:53.121ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25092025-01-15T00:46:53.124ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
25102025-01-15T00:46:53.124ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 520.850943ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25112025-01-15T00:46:53.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 1b163211-65f1-4846-a5f5-3b6343371d02 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
25122025-01-15T00:46:53.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 1b163211-65f1-4846-a5f5-3b6343371d02 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
25132025-01-15T00:46:53.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 1b163211-65f1-4846-a5f5-3b6343371d02 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
25142025-01-15T00:46:53.173ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25152025-01-15T00:46:53.173ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a16d4875-4fd3-4636-85ca-ae13e23bc5a7", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25162025-01-15T00:46:53.173ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25172025-01-15T00:46:53.175ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "562da488-b8c9-41ce-82c3-1eeb4d8a7995", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25182025-01-15T00:46:53.175ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25192025-01-15T00:46:53.177ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6047e010-58cc-42e5-86c4-4c03c42a330e", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25202025-01-15T00:46:53.177ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25212025-01-15T00:46:53.179ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25222025-01-15T00:46:53.179ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 576.103757ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25232025-01-15T00:46:53.226ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25242025-01-15T00:46:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25252025-01-15T00:46:53.228ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
25262025-01-15T00:46:53.228ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25272025-01-15T00:46:53.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25282025-01-15T00:46:53.237ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25292025-01-15T00:46:53.237ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c42625cd-6ae6-4c6d-9795-098fc80414ea", "content-length": "134", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
25302025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25312025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
25322025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25332025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25342025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25352025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25362025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25372025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25382025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25392025-01-15T00:46:53.237ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25402025-01-15T00:46:53.238ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
25412025-01-15T00:46:53.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25422025-01-15T00:46:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25432025-01-15T00:46:53.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25442025-01-15T00:46:53.240ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a74504e8-d6d7-42f0-b553-d67bc7c65aea", "content-length": "2", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
25452025-01-15T00:46:53.240ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25462025-01-15T00:46:53.240ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "43da21c3-a68a-459a-8994-69490b39c7e0", "content-length": "51", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
25472025-01-15T00:46:53.240ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
25482025-01-15T00:46:53.240ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25492025-01-15T00:46:53.244ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
25502025-01-15T00:46:53.244ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25512025-01-15T00:46:53.327ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "60bed46a-5b48-4296-982d-e3ff35b11ea5", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
25522025-01-15T00:46:53.327ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
25532025-01-15T00:46:53.327ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25542025-01-15T00:46:53.327ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5cde1833-aed4-4974-b8b4-d3a5b71f232a", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
25552025-01-15T00:46:53.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25562025-01-15T00:46:53.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25572025-01-15T00:46:53.328ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ee56f8b-77bb-464e-85a6-4d2a552ebd8c", "content-length": "682", "date": "Wed, 15 Jan 2025 00:46:52 GMT"} })
25582025-01-15T00:46:53.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25592025-01-15T00:46:53.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25602025-01-15T00:46:53.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25612025-01-15T00:46:53.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25622025-01-15T00:46:53.331ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25632025-01-15T00:46:53.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25642025-01-15T00:46:53.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25652025-01-15T00:46:53.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25662025-01-15T00:46:53.335ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25672025-01-15T00:46:53.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25682025-01-15T00:46:53.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25692025-01-15T00:46:53.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25702025-01-15T00:46:53.337ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25712025-01-15T00:46:53.337ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25722025-01-15T00:46:53.338ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0bd48e41-a943-4a7c-a79d-b42a5afea1aa", "date": "Wed, 15 Jan 2025 00:46:53 GMT"} })
25732025-01-15T00:46:53.340ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 732.794263ms iteration = 5 status = {}
25742025-01-15T00:46:53.343ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 738.825089ms iteration = 5 status = {}
25752025-01-15T00:46:53.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b11a43f3-a48f-4571-8a63-0e7412cf6da3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25762025-01-15T00:46:53.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b11a43f3-a48f-4571-8a63-0e7412cf6da3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25772025-01-15T00:46:53.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2407 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b11a43f3-a48f-4571-8a63-0e7412cf6da3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25782025-01-15T00:46:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 591 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = b0b59900-6bd6-4dc8-bb2e-033e2b616580 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
25792025-01-15T00:46:54.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e745603d-1b79-40e8-8bd9-76c9851dc0f4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25802025-01-15T00:46:54.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e745603d-1b79-40e8-8bd9-76c9851dc0f4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25812025-01-15T00:46:54.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2093 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e745603d-1b79-40e8-8bd9-76c9851dc0f4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25822025-01-15T00:46:55.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6ecb75c-1c39-4859-ad7c-8321e1afcfdc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25832025-01-15T00:46:55.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6ecb75c-1c39-4859-ad7c-8321e1afcfdc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25842025-01-15T00:46:55.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2315 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6ecb75c-1c39-4859-ad7c-8321e1afcfdc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25852025-01-15T00:46:57.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cdf55e2a-6642-4b92-8b78-71dbd7427e5f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25862025-01-15T00:46:57.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cdf55e2a-6642-4b92-8b78-71dbd7427e5f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25872025-01-15T00:46:57.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2692 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cdf55e2a-6642-4b92-8b78-71dbd7427e5f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25882025-01-15T00:46:58.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c47a0c40-f20f-43ed-9f68-c4954ffb3fe4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25892025-01-15T00:46:58.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c47a0c40-f20f-43ed-9f68-c4954ffb3fe4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25902025-01-15T00:46:58.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c47a0c40-f20f-43ed-9f68-c4954ffb3fe4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25912025-01-15T00:46:59.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b0555376-1865-4960-9b8e-0d9ad34a21f4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25922025-01-15T00:46:59.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b0555376-1865-4960-9b8e-0d9ad34a21f4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25932025-01-15T00:46:59.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3064 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b0555376-1865-4960-9b8e-0d9ad34a21f4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25942025-01-15T00:47:00.070ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fe035f53-4e49-49d0-9830-dda54223c01a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25952025-01-15T00:47:00.070ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fe035f53-4e49-49d0-9830-dda54223c01a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25962025-01-15T00:47:00.072ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fe035f53-4e49-49d0-9830-dda54223c01a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25972025-01-15T00:47:01.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 171f83cf-dc6f-4ec7-9a9a-03043c8487b6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25982025-01-15T00:47:01.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 171f83cf-dc6f-4ec7-9a9a-03043c8487b6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
25992025-01-15T00:47:01.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 171f83cf-dc6f-4ec7-9a9a-03043c8487b6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26002025-01-15T00:47:02.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c192acda-1211-4470-aa42-371a9d72c4a6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26012025-01-15T00:47:02.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c192acda-1211-4470-aa42-371a9d72c4a6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26022025-01-15T00:47:02.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1808 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c192acda-1211-4470-aa42-371a9d72c4a6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26032025-01-15T00:47:02.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
26042025-01-15T00:47:02.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26052025-01-15T00:47:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26062025-01-15T00:47:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
26072025-01-15T00:47:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26082025-01-15T00:47:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26092025-01-15T00:47:02.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26102025-01-15T00:47:02.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26112025-01-15T00:47:02.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26122025-01-15T00:47:02.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26132025-01-15T00:47:02.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26142025-01-15T00:47:02.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26152025-01-15T00:47:02.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26162025-01-15T00:47:02.642ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26172025-01-15T00:47:02.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26182025-01-15T00:47:02.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
26192025-01-15T00:47:02.642ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26202025-01-15T00:47:02.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26212025-01-15T00:47:02.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
26222025-01-15T00:47:02.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.676582ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
26232025-01-15T00:47:02.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.491999ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26242025-01-15T00:47:03.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 458243e5-1d65-4600-a871-db6629566aae roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26252025-01-15T00:47:03.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 458243e5-1d65-4600-a871-db6629566aae resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26262025-01-15T00:47:03.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 458243e5-1d65-4600-a871-db6629566aae response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26272025-01-15T00:47:04.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00e0e9d5-1a6f-48c9-8a29-9a769cbc6696 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26282025-01-15T00:47:04.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00e0e9d5-1a6f-48c9-8a29-9a769cbc6696 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26292025-01-15T00:47:04.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00e0e9d5-1a6f-48c9-8a29-9a769cbc6696 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26302025-01-15T00:47:04.284ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:42636
26312025-01-15T00:47:04.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 98d6a1b5-b105-47e7-bfbb-f10128b53edd roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
26322025-01-15T00:47:04.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 98d6a1b5-b105-47e7-bfbb-f10128b53edd resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
26332025-01-15T00:47:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 553 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = fea6ba15-1539-4842-8d09-de5e6e80564e response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
26342025-01-15T00:47:04.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6687 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 98d6a1b5-b105-47e7-bfbb-f10128b53edd response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
26352025-01-15T00:47:04.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 613eb0df-bafe-4dea-9bcb-00b41099c344 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmZjMTZmNy02NTA3LTQ4YTAtYTY3MC1hZDEzM2VlN2IyYjYifX0%3D
26362025-01-15T00:47:04.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 613eb0df-bafe-4dea-9bcb-00b41099c344 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmZjMTZmNy02NTA3LTQ4YTAtYTY3MC1hZDEzM2VlN2IyYjYifX0%3D
26372025-01-15T00:47:04.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2795 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 613eb0df-bafe-4dea-9bcb-00b41099c344 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmZjMTZmNy02NTA3LTQ4YTAtYTY3MC1hZDEzM2VlN2IyYjYifX0%3D
26382025-01-15T00:47:05.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1dfba870-8096-42db-9fb5-c1af1ace7dbf roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26392025-01-15T00:47:05.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1dfba870-8096-42db-9fb5-c1af1ace7dbf resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26402025-01-15T00:47:05.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1dfba870-8096-42db-9fb5-c1af1ace7dbf response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26412025-01-15T00:47:06.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 375350c7-9913-44cb-84d1-e761bd73ad29 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26422025-01-15T00:47:06.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 375350c7-9913-44cb-84d1-e761bd73ad29 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26432025-01-15T00:47:06.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 375350c7-9913-44cb-84d1-e761bd73ad29 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26442025-01-15T00:47:07.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6367e47d-e6cf-4f47-8f8e-b057aabf0a64 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26452025-01-15T00:47:07.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6367e47d-e6cf-4f47-8f8e-b057aabf0a64 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26462025-01-15T00:47:07.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1958 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6367e47d-e6cf-4f47-8f8e-b057aabf0a64 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26472025-01-15T00:47:08.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cdb2af4-7754-499f-bf34-d1ea0e2d04c0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26482025-01-15T00:47:08.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cdb2af4-7754-499f-bf34-d1ea0e2d04c0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26492025-01-15T00:47:08.242ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1978 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cdb2af4-7754-499f-bf34-d1ea0e2d04c0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26502025-01-15T00:47:09.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3e864905-81a7-4355-af99-cc35211d5986 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26512025-01-15T00:47:09.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3e864905-81a7-4355-af99-cc35211d5986 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26522025-01-15T00:47:09.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3e864905-81a7-4355-af99-cc35211d5986 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26532025-01-15T00:47:10.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bae8fba0-23cc-469c-9080-304380591b6a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26542025-01-15T00:47:10.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bae8fba0-23cc-469c-9080-304380591b6a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26552025-01-15T00:47:10.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bae8fba0-23cc-469c-9080-304380591b6a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26562025-01-15T00:47:11.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ce687ac3-d082-48dd-85ee-888a110de2a9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26572025-01-15T00:47:11.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ce687ac3-d082-48dd-85ee-888a110de2a9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26582025-01-15T00:47:11.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1960 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ce687ac3-d082-48dd-85ee-888a110de2a9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26592025-01-15T00:47:12.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a627bb37-c26d-4c9d-afc4-3495c2017636 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26602025-01-15T00:47:12.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a627bb37-c26d-4c9d-afc4-3495c2017636 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26612025-01-15T00:47:12.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a627bb37-c26d-4c9d-afc4-3495c2017636 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26622025-01-15T00:47:12.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
26632025-01-15T00:47:12.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26642025-01-15T00:47:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26652025-01-15T00:47:12.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26662025-01-15T00:47:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26672025-01-15T00:47:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26682025-01-15T00:47:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26692025-01-15T00:47:12.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
26702025-01-15T00:47:12.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26712025-01-15T00:47:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26722025-01-15T00:47:12.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26732025-01-15T00:47:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26742025-01-15T00:47:12.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26752025-01-15T00:47:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
26762025-01-15T00:47:12.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26772025-01-15T00:47:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26782025-01-15T00:47:12.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
26792025-01-15T00:47:12.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.36429ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
26802025-01-15T00:47:12.638ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26812025-01-15T00:47:12.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26822025-01-15T00:47:12.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.164266ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26832025-01-15T00:47:13.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1f62b2c8-dad5-4208-8254-24adb1b7d8c2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26842025-01-15T00:47:13.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1f62b2c8-dad5-4208-8254-24adb1b7d8c2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26852025-01-15T00:47:13.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1f62b2c8-dad5-4208-8254-24adb1b7d8c2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26862025-01-15T00:47:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 12301462-f6ca-4cc0-a13f-2555bb850e62 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
26872025-01-15T00:47:14.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 86a247de-1e95-4ce8-b793-98ddbf4bd395 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26882025-01-15T00:47:14.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 86a247de-1e95-4ce8-b793-98ddbf4bd395 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26892025-01-15T00:47:14.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2409 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 86a247de-1e95-4ce8-b793-98ddbf4bd395 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26902025-01-15T00:47:15.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = edcf4434-588d-457c-bb6f-33b0a56a9968 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26912025-01-15T00:47:15.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = edcf4434-588d-457c-bb6f-33b0a56a9968 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26922025-01-15T00:47:15.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = edcf4434-588d-457c-bb6f-33b0a56a9968 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26932025-01-15T00:47:16.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6e530f76-afb7-4fdb-8496-d1c86367922f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26942025-01-15T00:47:16.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6e530f76-afb7-4fdb-8496-d1c86367922f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26952025-01-15T00:47:16.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6e530f76-afb7-4fdb-8496-d1c86367922f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26962025-01-15T00:47:17.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a5b2e048-d7a4-4c45-946a-59ccfab9a43a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26972025-01-15T00:47:17.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a5b2e048-d7a4-4c45-946a-59ccfab9a43a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26982025-01-15T00:47:17.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a5b2e048-d7a4-4c45-946a-59ccfab9a43a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
26992025-01-15T00:47:18.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c3cec831-3b96-490b-bf67-5ab407fbb734 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27002025-01-15T00:47:18.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c3cec831-3b96-490b-bf67-5ab407fbb734 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27012025-01-15T00:47:18.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c3cec831-3b96-490b-bf67-5ab407fbb734 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27022025-01-15T00:47:19.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = b29e665e-1654-4a2f-987a-f5c8e10b0126 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
27032025-01-15T00:47:19.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = b29e665e-1654-4a2f-987a-f5c8e10b0126 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
27042025-01-15T00:47:19.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3365 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = b29e665e-1654-4a2f-987a-f5c8e10b0126 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
27052025-01-15T00:47:19.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 13e50fa3-3974-4abd-bdd5-fdc29664f7fe roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmZjMTZmNy02NTA3LTQ4YTAtYTY3MC1hZDEzM2VlN2IyYjYifX0%3D
27062025-01-15T00:47:19.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 13e50fa3-3974-4abd-bdd5-fdc29664f7fe resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmZjMTZmNy02NTA3LTQ4YTAtYTY3MC1hZDEzM2VlN2IyYjYifX0%3D
27072025-01-15T00:47:19.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2489 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 13e50fa3-3974-4abd-bdd5-fdc29664f7fe response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiMmZjMTZmNy02NTA3LTQ4YTAtYTY3MC1hZDEzM2VlN2IyYjYifX0%3D
27082025-01-15T00:47:19.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c509cd22-4dc7-4614-a647-68bf6f8965ce roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27092025-01-15T00:47:19.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c509cd22-4dc7-4614-a647-68bf6f8965ce resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27102025-01-15T00:47:19.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2568 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c509cd22-4dc7-4614-a647-68bf6f8965ce response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27112025-01-15T00:47:20.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d91a550-2adc-4808-bec5-3e75de846b03 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27122025-01-15T00:47:20.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d91a550-2adc-4808-bec5-3e75de846b03 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27132025-01-15T00:47:20.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d91a550-2adc-4808-bec5-3e75de846b03 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27142025-01-15T00:47:21.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 38f698fe-b26f-4938-9dea-50f61d7f94f4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27152025-01-15T00:47:21.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 38f698fe-b26f-4938-9dea-50f61d7f94f4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27162025-01-15T00:47:21.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1847 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 38f698fe-b26f-4938-9dea-50f61d7f94f4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27172025-01-15T00:47:22.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d3c2742-827e-460d-8f92-a580ae6156ff roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27182025-01-15T00:47:22.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d3c2742-827e-460d-8f92-a580ae6156ff resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27192025-01-15T00:47:22.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d3c2742-827e-460d-8f92-a580ae6156ff response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
27202025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
27212025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
27222025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27232025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
27242025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27252025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
27262025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27272025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27282025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27292025-01-15T00:47:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27302025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
27312025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
27322025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
27332025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27342025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27352025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
27362025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27372025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27382025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27392025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27402025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.474578ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27412025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27422025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27432025-01-15T00:47:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27442025-01-15T00:47:22.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27452025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27462025-01-15T00:47:22.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1062, tv_nsec: 937253598 } })
27472025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
27482025-01-15T00:47:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27492025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
27502025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27512025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27522025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
27532025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
27542025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27552025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27562025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
27572025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27582025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
27592025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27602025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27612025-01-15T00:47:22.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1062, tv_nsec: 937462472 } })
27622025-01-15T00:47:22.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
27632025-01-15T00:47:22.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
27642025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27652025-01-15T00:47:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27662025-01-15T00:47:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27672025-01-15T00:47:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27682025-01-15T00:47:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27692025-01-15T00:47:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27702025-01-15T00:47:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27712025-01-15T00:47:22.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27722025-01-15T00:47:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27732025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
27742025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27752025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
27762025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27772025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
27782025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27792025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
27802025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27812025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27822025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27832025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27842025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27852025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
27862025-01-15T00:47:22.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27872025-01-15T00:47:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27882025-01-15T00:47:22.611ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27892025-01-15T00:47:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27902025-01-15T00:47:22.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27912025-01-15T00:47:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27922025-01-15T00:47:22.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27932025-01-15T00:47:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27942025-01-15T00:47:22.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27952025-01-15T00:47:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27962025-01-15T00:47:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27972025-01-15T00:47:22.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27982025-01-15T00:47:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27992025-01-15T00:47:22.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28002025-01-15T00:47:22.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28012025-01-15T00:47:22.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28022025-01-15T00:47:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28032025-01-15T00:47:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28042025-01-15T00:47:22.619ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28052025-01-15T00:47:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28062025-01-15T00:47:22.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28072025-01-15T00:47:22.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28082025-01-15T00:47:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28092025-01-15T00:47:22.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28102025-01-15T00:47:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28112025-01-15T00:47:22.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28122025-01-15T00:47:22.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28132025-01-15T00:47:22.625ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1062, tv_nsec: 954916618 } })
28142025-01-15T00:47:22.625ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
28152025-01-15T00:47:22.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28162025-01-15T00:47:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28172025-01-15T00:47:22.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28182025-01-15T00:47:22.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28192025-01-15T00:47:22.660ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28202025-01-15T00:47:22.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28212025-01-15T00:47:22.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.678902ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
28222025-01-15T00:47:22.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28232025-01-15T00:47:22.664ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28242025-01-15T00:47:22.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28252025-01-15T00:47:22.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28262025-01-15T00:47:22.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28272025-01-15T00:47:22.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
28282025-01-15T00:47:22.667ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28292025-01-15T00:47:22.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28302025-01-15T00:47:22.667ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28312025-01-15T00:47:22.667ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28322025-01-15T00:47:22.667ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28332025-01-15T00:47:22.667ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28342025-01-15T00:47:22.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28352025-01-15T00:47:22.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28362025-01-15T00:47:22.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28372025-01-15T00:47:22.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28382025-01-15T00:47:22.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.768221ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
28392025-01-15T00:47:22.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
28402025-01-15T00:47:22.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28412025-01-15T00:47:22.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28422025-01-15T00:47:22.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28432025-01-15T00:47:22.670ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28442025-01-15T00:47:22.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28452025-01-15T00:47:22.672ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28462025-01-15T00:47:22.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
28472025-01-15T00:47:22.676ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28482025-01-15T00:47:22.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28492025-01-15T00:47:22.676ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28502025-01-15T00:47:22.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 68.941727ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28512025-01-15T00:47:22.677ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.77088ms iteration = 6 status = 0
28522025-01-15T00:47:22.689ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
28532025-01-15T00:47:22.689ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28542025-01-15T00:47:22.690ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c57817b1-37d4-4bf8-a892-7a1b48859141", "content-length": "26", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
28552025-01-15T00:47:22.690ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28562025-01-15T00:47:22.690ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
28572025-01-15T00:47:22.690ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 87.398952ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
28582025-01-15T00:47:22.692ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28592025-01-15T00:47:22.694ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.901502ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28602025-01-15T00:47:22.695ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28612025-01-15T00:47:22.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
28622025-01-15T00:47:22.698ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28632025-01-15T00:47:22.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28642025-01-15T00:47:22.700ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28652025-01-15T00:47:22.700ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28662025-01-15T00:47:22.700ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28672025-01-15T00:47:22.700ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28682025-01-15T00:47:22.702ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 92.222985ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28692025-01-15T00:47:22.702ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28702025-01-15T00:47:22.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28712025-01-15T00:47:22.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28722025-01-15T00:47:22.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28732025-01-15T00:47:22.741ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
28742025-01-15T00:47:22.741ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 136.483357ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
28752025-01-15T00:47:22.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28762025-01-15T00:47:22.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
28772025-01-15T00:47:22.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.132271ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
28782025-01-15T00:47:22.749ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 139.854471ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28792025-01-15T00:47:22.766ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28802025-01-15T00:47:22.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28812025-01-15T00:47:22.768ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
28822025-01-15T00:47:22.768ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28832025-01-15T00:47:22.768ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d2fccd7-566d-46f7-a60a-5f75a6b39315", "content-length": "26", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
28842025-01-15T00:47:22.768ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28852025-01-15T00:47:22.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28862025-01-15T00:47:22.787ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
28872025-01-15T00:47:22.787ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f745733d-2c60-4480-b42c-8891beec8cb0", "content-length": "1", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
28882025-01-15T00:47:22.789ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28892025-01-15T00:47:22.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28902025-01-15T00:47:22.791ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
28912025-01-15T00:47:22.791ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28922025-01-15T00:47:22.791ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c093a646-d258-4704-bf75-b79285c6ca25", "content-length": "26", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
28932025-01-15T00:47:22.791ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28942025-01-15T00:47:22.793ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
28952025-01-15T00:47:22.794ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.878886ms iteration = 8 status = {"physical_disks_added":0}
28962025-01-15T00:47:22.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28972025-01-15T00:47:22.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28982025-01-15T00:47:22.844ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28992025-01-15T00:47:22.844ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29002025-01-15T00:47:22.845ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef38f3c7-f937-4546-acb5-fe85eff52f58", "content-length": "372", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29012025-01-15T00:47:22.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29022025-01-15T00:47:22.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29032025-01-15T00:47:22.846ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 239.166832ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29042025-01-15T00:47:22.847ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 244.091488ms iteration = 6 status = null
29052025-01-15T00:47:22.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29062025-01-15T00:47:22.849ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29072025-01-15T00:47:22.849ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29082025-01-15T00:47:22.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29092025-01-15T00:47:22.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29102025-01-15T00:47:22.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
29112025-01-15T00:47:22.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29122025-01-15T00:47:22.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29132025-01-15T00:47:22.861ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 258.670828ms iteration = 6 status = {}
29142025-01-15T00:47:22.895ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
29152025-01-15T00:47:22.895ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29162025-01-15T00:47:22.895ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "05ab90dc-1cc0-4e7e-839e-8747d1223c55", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29172025-01-15T00:47:22.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29182025-01-15T00:47:22.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29192025-01-15T00:47:22.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29202025-01-15T00:47:22.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29212025-01-15T00:47:22.901ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29222025-01-15T00:47:22.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29232025-01-15T00:47:22.905ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29242025-01-15T00:47:22.906ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29252025-01-15T00:47:22.906ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1fdcb57b-115b-4762-974d-f134b2d761a5", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29262025-01-15T00:47:22.907ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.121216ms iteration = 6 status = {}
29272025-01-15T00:47:22.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29282025-01-15T00:47:22.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29292025-01-15T00:47:22.964ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29302025-01-15T00:47:22.964ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb34ef4e-2742-4c8b-b054-b22a85509cfe", "content-length": "691", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29312025-01-15T00:47:22.964ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
29322025-01-15T00:47:22.964ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
29332025-01-15T00:47:22.964ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
29342025-01-15T00:47:22.965ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 357.575081ms iteration = 6 status = {}
29352025-01-15T00:47:22.966ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
29362025-01-15T00:47:22.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29372025-01-15T00:47:22.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29382025-01-15T00:47:23.077ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29392025-01-15T00:47:23.077ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "999f4489-3d3c-4057-a6b3-924189fcb18f", "content-length": "134", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29402025-01-15T00:47:23.077ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29412025-01-15T00:47:23.077ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
29422025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29432025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29442025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29452025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29462025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29472025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29482025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29492025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29502025-01-15T00:47:23.078ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
29512025-01-15T00:47:23.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29522025-01-15T00:47:23.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29532025-01-15T00:47:23.080ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29542025-01-15T00:47:23.081ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba5521f9-1bdc-473d-be1a-926e387ed547", "content-length": "2", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29552025-01-15T00:47:23.081ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29562025-01-15T00:47:23.081ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c259a34-ee69-41e2-bee6-373d81c32d1c", "content-length": "51", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29572025-01-15T00:47:23.081ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
29582025-01-15T00:47:23.081ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29592025-01-15T00:47:23.174ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b2d941a7-d42d-4576-a478-26f8c2a475bc", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29602025-01-15T00:47:23.174ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
29612025-01-15T00:47:23.174ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29622025-01-15T00:47:23.175ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "28d364b1-cc5a-4e90-a72e-4fa3fd70cd30", "content-length": "682", "date": "Wed, 15 Jan 2025 00:47:22 GMT"} })
29632025-01-15T00:47:23.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29642025-01-15T00:47:23.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29652025-01-15T00:47:23.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29662025-01-15T00:47:23.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29672025-01-15T00:47:23.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29682025-01-15T00:47:23.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29692025-01-15T00:47:23.183ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29702025-01-15T00:47:23.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29712025-01-15T00:47:23.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 47d97a23-178c-4f37-89c7-c89763142a5b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
29722025-01-15T00:47:23.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 47d97a23-178c-4f37-89c7-c89763142a5b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
29732025-01-15T00:47:23.190ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 585.219223ms iteration = 6 status = {}
29742025-01-15T00:47:23.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2961 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 47d97a23-178c-4f37-89c7-c89763142a5b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
29752025-01-15T00:47:23.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 559ee743-105f-438a-ade9-6c404e56f649 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29762025-01-15T00:47:23.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 559ee743-105f-438a-ade9-6c404e56f649 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29772025-01-15T00:47:23.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1794 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 559ee743-105f-438a-ade9-6c404e56f649 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29782025-01-15T00:47:24.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 616 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = dc162693-960e-4f40-a506-347e2f70bca8 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
29792025-01-15T00:47:24.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f28f1685-7036-487b-b2eb-a19e6bef615a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29802025-01-15T00:47:24.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f28f1685-7036-487b-b2eb-a19e6bef615a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29812025-01-15T00:47:24.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2851 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f28f1685-7036-487b-b2eb-a19e6bef615a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29822025-01-15T00:47:25.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 650cbb2a-87c3-497b-9578-25d6f0426c78 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29832025-01-15T00:47:25.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 650cbb2a-87c3-497b-9578-25d6f0426c78 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29842025-01-15T00:47:25.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2555 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 650cbb2a-87c3-497b-9578-25d6f0426c78 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29852025-01-15T00:47:26.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d82ef16c-16f2-4c91-85af-10264510345a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29862025-01-15T00:47:26.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d82ef16c-16f2-4c91-85af-10264510345a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29872025-01-15T00:47:26.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d82ef16c-16f2-4c91-85af-10264510345a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29882025-01-15T00:47:27.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5c617ab2-6386-427a-a119-1bcc5e763300 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29892025-01-15T00:47:27.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5c617ab2-6386-427a-a119-1bcc5e763300 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29902025-01-15T00:47:27.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5c617ab2-6386-427a-a119-1bcc5e763300 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29912025-01-15T00:47:28.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 286290f6-4dac-422c-adcc-dbe867e79bb6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29922025-01-15T00:47:28.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 286290f6-4dac-422c-adcc-dbe867e79bb6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29932025-01-15T00:47:28.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2788 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 286290f6-4dac-422c-adcc-dbe867e79bb6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29942025-01-15T00:47:29.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 50eafdc4-7d08-4cb2-af54-dcc21b22e307 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29952025-01-15T00:47:29.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 50eafdc4-7d08-4cb2-af54-dcc21b22e307 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29962025-01-15T00:47:29.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 50eafdc4-7d08-4cb2-af54-dcc21b22e307 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29972025-01-15T00:47:30.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 076273f4-3371-448b-b8c4-407c4c6869f1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29982025-01-15T00:47:30.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 076273f4-3371-448b-b8c4-407c4c6869f1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
29992025-01-15T00:47:30.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2911 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 076273f4-3371-448b-b8c4-407c4c6869f1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30002025-01-15T00:47:31.798ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1efab9ce-3e2e-494e-a19b-aea0a84eca4d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30012025-01-15T00:47:31.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1efab9ce-3e2e-494e-a19b-aea0a84eca4d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30022025-01-15T00:47:31.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1efab9ce-3e2e-494e-a19b-aea0a84eca4d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30032025-01-15T00:47:32.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
30042025-01-15T00:47:32.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30052025-01-15T00:47:32.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30062025-01-15T00:47:32.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
30072025-01-15T00:47:32.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30082025-01-15T00:47:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30092025-01-15T00:47:32.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30102025-01-15T00:47:32.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30112025-01-15T00:47:32.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30122025-01-15T00:47:32.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30132025-01-15T00:47:32.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30142025-01-15T00:47:32.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30152025-01-15T00:47:32.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30162025-01-15T00:47:32.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30172025-01-15T00:47:32.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30182025-01-15T00:47:32.641ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
30192025-01-15T00:47:32.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30202025-01-15T00:47:32.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30212025-01-15T00:47:32.649ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
30222025-01-15T00:47:32.649ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.472203ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
30232025-01-15T00:47:32.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.8054ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30242025-01-15T00:47:32.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e9030c13-d959-4faa-8f48-c9a132bd5017 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30252025-01-15T00:47:32.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e9030c13-d959-4faa-8f48-c9a132bd5017 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30262025-01-15T00:47:32.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2318 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e9030c13-d959-4faa-8f48-c9a132bd5017 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30272025-01-15T00:47:33.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6097b634-8a27-45d0-ad7c-9ec036da07ec roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30282025-01-15T00:47:33.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6097b634-8a27-45d0-ad7c-9ec036da07ec resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30292025-01-15T00:47:33.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6097b634-8a27-45d0-ad7c-9ec036da07ec response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30302025-01-15T00:47:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 540 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 25bdb49b-eb04-408c-8968-431a2fffb95d response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
30312025-01-15T00:47:34.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46c5f37c-7211-49b5-8110-a8a01eafada5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30322025-01-15T00:47:34.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46c5f37c-7211-49b5-8110-a8a01eafada5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30332025-01-15T00:47:34.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46c5f37c-7211-49b5-8110-a8a01eafada5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30342025-01-15T00:47:35.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8345acab-c7af-4c73-9603-21c199244374 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30352025-01-15T00:47:35.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8345acab-c7af-4c73-9603-21c199244374 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30362025-01-15T00:47:35.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8345acab-c7af-4c73-9603-21c199244374 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30372025-01-15T00:47:36.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 24ea9f3f-2acd-4b53-84f5-3fd72f6a688b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30382025-01-15T00:47:36.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 24ea9f3f-2acd-4b53-84f5-3fd72f6a688b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30392025-01-15T00:47:36.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 24ea9f3f-2acd-4b53-84f5-3fd72f6a688b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30402025-01-15T00:47:37.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9dc9225c-39c5-43e5-9c0c-79cac561e256 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30412025-01-15T00:47:37.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9dc9225c-39c5-43e5-9c0c-79cac561e256 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30422025-01-15T00:47:37.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4766 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9dc9225c-39c5-43e5-9c0c-79cac561e256 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30432025-01-15T00:47:38.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8ad318c-5209-4d9d-aeaa-a1354cef5624 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30442025-01-15T00:47:38.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8ad318c-5209-4d9d-aeaa-a1354cef5624 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30452025-01-15T00:47:38.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1903 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8ad318c-5209-4d9d-aeaa-a1354cef5624 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30462025-01-15T00:47:39.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ceffeb2-4785-41b7-a4cc-029746354774 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30472025-01-15T00:47:39.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ceffeb2-4785-41b7-a4cc-029746354774 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30482025-01-15T00:47:39.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ceffeb2-4785-41b7-a4cc-029746354774 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30492025-01-15T00:47:40.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4d29633-ed42-4923-bfc2-b4a5731e2e1c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30502025-01-15T00:47:40.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4d29633-ed42-4923-bfc2-b4a5731e2e1c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30512025-01-15T00:47:40.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4d29633-ed42-4923-bfc2-b4a5731e2e1c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30522025-01-15T00:47:42.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5e3b2ecc-b94c-4b5b-ab82-493577e75164 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30532025-01-15T00:47:42.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5e3b2ecc-b94c-4b5b-ab82-493577e75164 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30542025-01-15T00:47:42.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5e3b2ecc-b94c-4b5b-ab82-493577e75164 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30552025-01-15T00:47:42.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
30562025-01-15T00:47:42.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30572025-01-15T00:47:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30582025-01-15T00:47:42.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
30592025-01-15T00:47:42.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30602025-01-15T00:47:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30612025-01-15T00:47:42.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30622025-01-15T00:47:42.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30632025-01-15T00:47:42.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30642025-01-15T00:47:42.637ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30652025-01-15T00:47:42.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30662025-01-15T00:47:42.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30672025-01-15T00:47:42.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30682025-01-15T00:47:42.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30692025-01-15T00:47:42.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30702025-01-15T00:47:42.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
30712025-01-15T00:47:42.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30722025-01-15T00:47:42.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30732025-01-15T00:47:42.655ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
30742025-01-15T00:47:42.655ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.567362ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
30752025-01-15T00:47:42.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.045678ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30762025-01-15T00:47:43.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cc60c0c-19c4-4668-99e5-3c19fa811b0e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30772025-01-15T00:47:43.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cc60c0c-19c4-4668-99e5-3c19fa811b0e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30782025-01-15T00:47:43.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cc60c0c-19c4-4668-99e5-3c19fa811b0e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30792025-01-15T00:47:44.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e4e0fc4-0d73-4315-a226-06b46452a963 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30802025-01-15T00:47:44.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e4e0fc4-0d73-4315-a226-06b46452a963 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30812025-01-15T00:47:44.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e4e0fc4-0d73-4315-a226-06b46452a963 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30822025-01-15T00:47:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 41bbff81-45cf-4ff8-b82d-8e2e9d2030a4 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
30832025-01-15T00:47:45.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b1dbe96c-906f-4706-9408-4d103e4ee175 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30842025-01-15T00:47:45.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b1dbe96c-906f-4706-9408-4d103e4ee175 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30852025-01-15T00:47:45.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b1dbe96c-906f-4706-9408-4d103e4ee175 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30862025-01-15T00:47:46.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c4bab671-735c-4ebd-bfca-bac19af6fe15 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30872025-01-15T00:47:46.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c4bab671-735c-4ebd-bfca-bac19af6fe15 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30882025-01-15T00:47:46.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c4bab671-735c-4ebd-bfca-bac19af6fe15 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30892025-01-15T00:47:47.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5daa3304-da39-446a-90e1-4a1c3b1436de roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30902025-01-15T00:47:47.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5daa3304-da39-446a-90e1-4a1c3b1436de resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30912025-01-15T00:47:47.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5daa3304-da39-446a-90e1-4a1c3b1436de response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30922025-01-15T00:47:48.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b8e28bb9-5f3a-4c10-8e2b-73e0b032e16b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30932025-01-15T00:47:48.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b8e28bb9-5f3a-4c10-8e2b-73e0b032e16b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30942025-01-15T00:47:48.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b8e28bb9-5f3a-4c10-8e2b-73e0b032e16b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30952025-01-15T00:47:49.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa3ae3fe-97d0-4a10-8238-45fb111ba31a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30962025-01-15T00:47:49.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa3ae3fe-97d0-4a10-8238-45fb111ba31a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30972025-01-15T00:47:49.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2161 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa3ae3fe-97d0-4a10-8238-45fb111ba31a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30982025-01-15T00:47:50.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5bef5e30-81ee-41f8-a442-aa9f564df536 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
30992025-01-15T00:47:50.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5bef5e30-81ee-41f8-a442-aa9f564df536 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
31002025-01-15T00:47:50.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5bef5e30-81ee-41f8-a442-aa9f564df536 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
31012025-01-15T00:47:51.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b15ec70d-2253-4bcf-857d-cf83b5953add roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
31022025-01-15T00:47:51.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b15ec70d-2253-4bcf-857d-cf83b5953add resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
31032025-01-15T00:47:51.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1640 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b15ec70d-2253-4bcf-857d-cf83b5953add response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
31042025-01-15T00:47:52.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2861bb3d-cbbc-4ad2-ae2a-06be052aa890 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
31052025-01-15T00:47:52.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2861bb3d-cbbc-4ad2-ae2a-06be052aa890 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
31062025-01-15T00:47:52.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2861bb3d-cbbc-4ad2-ae2a-06be052aa890 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
31072025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
31082025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31092025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
31102025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
31112025-01-15T00:47:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
31122025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.931\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
31132025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
31142025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
31152025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
31162025-01-15T00:47:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:37:52.603365683 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31172025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31182025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31192025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
31202025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31212025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31222025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31232025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
31242025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
31252025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
31262025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31272025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
31282025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31292025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31302025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
31312025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
31322025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31332025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31342025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31352025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31362025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31372025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31382025-01-15T00:47:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31392025-01-15T00:47:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1092, tv_nsec: 933759531 } })
31402025-01-15T00:47:52.604ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1092, tv_nsec: 933907814 } })
31412025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
31422025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.03158ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
31432025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
31442025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
31452025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31462025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31472025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
31482025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
31492025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31502025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
31512025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31522025-01-15T00:47:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31532025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
31542025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31552025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31562025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
31572025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.306615ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
31582025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31592025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31602025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31612025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31622025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31632025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31642025-01-15T00:47:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31652025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31662025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31672025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31682025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31692025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31702025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
31712025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31722025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
31732025-01-15T00:47:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31742025-01-15T00:47:52.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1092, tv_nsec: 936651946 } })
31752025-01-15T00:47:52.606ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31762025-01-15T00:47:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1092, tv_nsec: 936987343 } })
31772025-01-15T00:47:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
31782025-01-15T00:47:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
31792025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.005517ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
31802025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
31812025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
31822025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31832025-01-15T00:47:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31842025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31852025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
31862025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
31872025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31882025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31892025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
31902025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31912025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31922025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
31932025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31942025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
31952025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31962025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31972025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31982025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
31992025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32002025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32012025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32022025-01-15T00:47:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32032025-01-15T00:47:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32042025-01-15T00:47:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32052025-01-15T00:47:52.608ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:37:52.603365683 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32062025-01-15T00:47:52.608ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.976085ms iteration = 4 status = {"expiration":"2025-01-15T00:37:52.603365683Z","pruned":[]}
32072025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32082025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
32092025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
32102025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32112025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
32122025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
32132025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32142025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
32152025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32162025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
32172025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32182025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
32192025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
32202025-01-15T00:47:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32212025-01-15T00:47:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32222025-01-15T00:47:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32232025-01-15T00:47:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
32242025-01-15T00:47:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32252025-01-15T00:47:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32262025-01-15T00:47:52.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32272025-01-15T00:47:52.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32282025-01-15T00:47:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32292025-01-15T00:47:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32302025-01-15T00:47:52.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32312025-01-15T00:47:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32322025-01-15T00:47:52.614ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32332025-01-15T00:47:52.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32342025-01-15T00:47:52.614ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32352025-01-15T00:47:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32362025-01-15T00:47:52.617ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32372025-01-15T00:47:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32382025-01-15T00:47:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32392025-01-15T00:47:52.617ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32402025-01-15T00:47:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32412025-01-15T00:47:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32422025-01-15T00:47:52.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32432025-01-15T00:47:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32442025-01-15T00:47:52.619ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32452025-01-15T00:47:52.620ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32462025-01-15T00:47:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32472025-01-15T00:47:52.622ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32482025-01-15T00:47:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32492025-01-15T00:47:52.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32502025-01-15T00:47:52.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32512025-01-15T00:47:52.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32522025-01-15T00:47:52.626ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32532025-01-15T00:47:52.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32542025-01-15T00:47:52.632ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32552025-01-15T00:47:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
32562025-01-15T00:47:52.640ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 30.713851ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
32572025-01-15T00:47:52.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32582025-01-15T00:47:52.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32592025-01-15T00:47:52.647ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32602025-01-15T00:47:52.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32612025-01-15T00:47:52.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32622025-01-15T00:47:52.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32632025-01-15T00:47:52.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32642025-01-15T00:47:52.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32652025-01-15T00:47:52.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32662025-01-15T00:47:52.663ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32672025-01-15T00:47:52.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32682025-01-15T00:47:52.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32692025-01-15T00:47:52.666ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32702025-01-15T00:47:52.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32712025-01-15T00:47:52.668ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32722025-01-15T00:47:52.668ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32732025-01-15T00:47:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32742025-01-15T00:47:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32752025-01-15T00:47:52.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32762025-01-15T00:47:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32772025-01-15T00:47:52.673ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32782025-01-15T00:47:52.673ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32792025-01-15T00:47:52.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32802025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
32812025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
32822025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
32832025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32842025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32852025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32862025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32872025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32882025-01-15T00:47:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32892025-01-15T00:47:52.676ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32902025-01-15T00:47:52.678ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32912025-01-15T00:47:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
32922025-01-15T00:47:52.678ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32932025-01-15T00:47:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
32942025-01-15T00:47:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32952025-01-15T00:47:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
32962025-01-15T00:47:52.678ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32972025-01-15T00:47:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32982025-01-15T00:47:52.679ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32992025-01-15T00:47:52.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33002025-01-15T00:47:52.679ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33012025-01-15T00:47:52.679ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33022025-01-15T00:47:52.679ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.754642ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33032025-01-15T00:47:52.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33042025-01-15T00:47:52.679ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33052025-01-15T00:47:52.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33062025-01-15T00:47:52.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33072025-01-15T00:47:52.681ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.557126ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33082025-01-15T00:47:52.681ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33092025-01-15T00:47:52.681ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33102025-01-15T00:47:52.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33112025-01-15T00:47:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33122025-01-15T00:47:52.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33132025-01-15T00:47:52.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.355322ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
33142025-01-15T00:47:52.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33152025-01-15T00:47:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33162025-01-15T00:47:52.683ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 78.820217ms iteration = 3 status = {"nsuccess":5}
33172025-01-15T00:47:52.683ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1093, tv_nsec: 13683969 } })
33182025-01-15T00:47:52.684ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
33192025-01-15T00:47:52.684ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33202025-01-15T00:47:52.684ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33212025-01-15T00:47:52.684ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33222025-01-15T00:47:52.684ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33232025-01-15T00:47:52.684ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33242025-01-15T00:47:52.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33252025-01-15T00:47:52.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33262025-01-15T00:47:52.687ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33272025-01-15T00:47:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33282025-01-15T00:47:52.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33292025-01-15T00:47:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
33302025-01-15T00:47:52.687ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33312025-01-15T00:47:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33322025-01-15T00:47:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33332025-01-15T00:47:52.687ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33342025-01-15T00:47:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33352025-01-15T00:47:52.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.492261ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
33362025-01-15T00:47:52.689ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33372025-01-15T00:47:52.689ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33382025-01-15T00:47:52.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33392025-01-15T00:47:52.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33402025-01-15T00:47:52.691ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33412025-01-15T00:47:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33422025-01-15T00:47:52.694ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33432025-01-15T00:47:52.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33442025-01-15T00:47:52.695ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33452025-01-15T00:47:52.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33462025-01-15T00:47:52.696ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.602375ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33472025-01-15T00:47:52.700ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
33482025-01-15T00:47:52.700ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 97.383714ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
33492025-01-15T00:47:52.708ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33502025-01-15T00:47:52.708ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33512025-01-15T00:47:52.708ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.006412ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33522025-01-15T00:47:52.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33532025-01-15T00:47:52.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33542025-01-15T00:47:52.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33552025-01-15T00:47:52.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33562025-01-15T00:47:52.713ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33572025-01-15T00:47:52.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33582025-01-15T00:47:52.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33592025-01-15T00:47:52.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33602025-01-15T00:47:52.718ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33612025-01-15T00:47:52.721ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
33622025-01-15T00:47:52.721ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33632025-01-15T00:47:52.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33642025-01-15T00:47:52.723ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33652025-01-15T00:47:52.723ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 119.269405ms iteration = 7 status = 0
33662025-01-15T00:47:52.725ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33672025-01-15T00:47:52.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33682025-01-15T00:47:52.725ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33692025-01-15T00:47:52.725ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33702025-01-15T00:47:52.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33712025-01-15T00:47:52.729ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33722025-01-15T00:47:52.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33732025-01-15T00:47:52.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33742025-01-15T00:47:52.733ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33752025-01-15T00:47:52.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33762025-01-15T00:47:52.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33772025-01-15T00:47:52.735ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 126.23028ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
33782025-01-15T00:47:52.740ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33792025-01-15T00:47:52.740ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33802025-01-15T00:47:52.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33812025-01-15T00:47:52.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33822025-01-15T00:47:52.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33832025-01-15T00:47:52.743ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33842025-01-15T00:47:52.743ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33852025-01-15T00:47:52.743ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33862025-01-15T00:47:52.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33872025-01-15T00:47:52.746ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33882025-01-15T00:47:52.746ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 138.667589ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33892025-01-15T00:47:52.747ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
33902025-01-15T00:47:52.747ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
33912025-01-15T00:47:52.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33922025-01-15T00:47:52.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33932025-01-15T00:47:52.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33942025-01-15T00:47:52.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33952025-01-15T00:47:52.747ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33962025-01-15T00:47:52.747ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33972025-01-15T00:47:52.747ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 140.095816ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33982025-01-15T00:47:52.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33992025-01-15T00:47:52.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34002025-01-15T00:47:52.752ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
34012025-01-15T00:47:52.752ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
34022025-01-15T00:47:52.752ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
34032025-01-15T00:47:52.752ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 148.60547ms iteration = 4 status = {"generation":1}
34042025-01-15T00:47:52.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34052025-01-15T00:47:52.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34062025-01-15T00:47:52.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34072025-01-15T00:47:52.754ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
34082025-01-15T00:47:52.754ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34092025-01-15T00:47:52.754ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
34102025-01-15T00:47:52.754ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 150.71311ms iteration = 4 status = {"generation":2}
34112025-01-15T00:47:52.759ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34122025-01-15T00:47:52.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34132025-01-15T00:47:52.761ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34142025-01-15T00:47:52.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34152025-01-15T00:47:52.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.707805ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
34162025-01-15T00:47:52.767ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
34172025-01-15T00:47:52.767ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34182025-01-15T00:47:52.767ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "40359848-0a2d-4a17-bcfc-c1ad0b136c10", "content-length": "26", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
34192025-01-15T00:47:52.767ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34202025-01-15T00:47:52.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34212025-01-15T00:47:52.775ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
34222025-01-15T00:47:52.775ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34232025-01-15T00:47:52.775ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2810918-6e27-4f3b-8cf0-659dfef01c37", "content-length": "26", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
34242025-01-15T00:47:52.775ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34252025-01-15T00:47:52.777ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34262025-01-15T00:47:52.786ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
34272025-01-15T00:47:52.786ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 183.4013ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
34282025-01-15T00:47:52.796ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
34292025-01-15T00:47:52.796ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 192.031516ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
34302025-01-15T00:47:52.799ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34312025-01-15T00:47:52.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34322025-01-15T00:47:52.802ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34332025-01-15T00:47:52.804ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34342025-01-15T00:47:52.804ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34352025-01-15T00:47:52.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34362025-01-15T00:47:52.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34372025-01-15T00:47:52.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34382025-01-15T00:47:52.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34392025-01-15T00:47:52.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34402025-01-15T00:47:52.811ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.35167ms iteration = 9 status = {"physical_disks_added":0}
34412025-01-15T00:47:52.815ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34422025-01-15T00:47:52.815ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.33014ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34432025-01-15T00:47:52.962ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 359.462038ms iteration = 7 status = {}
34442025-01-15T00:47:52.990ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34452025-01-15T00:47:52.996ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34462025-01-15T00:47:53.013ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34472025-01-15T00:47:53.013ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34482025-01-15T00:47:53.014ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f64caad4-de82-44bc-9179-be202f6b13ea", "content-length": "372", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
34492025-01-15T00:47:53.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34502025-01-15T00:47:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34512025-01-15T00:47:53.054ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34522025-01-15T00:47:53.054ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "026fb7eb-fd44-4729-9e4c-801439e3be02", "content-length": "1", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
34532025-01-15T00:47:53.056ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
34542025-01-15T00:47:53.056ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34552025-01-15T00:47:53.056ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34562025-01-15T00:47:53.056ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9f68aff7-37ca-41c5-9202-344657f2a607", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
34572025-01-15T00:47:53.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34582025-01-15T00:47:53.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34592025-01-15T00:47:53.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34602025-01-15T00:47:53.058ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 454.773972ms iteration = 7 status = null
34612025-01-15T00:47:53.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34622025-01-15T00:47:53.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34632025-01-15T00:47:53.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34642025-01-15T00:47:53.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34652025-01-15T00:47:53.066ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
34662025-01-15T00:47:53.066ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34672025-01-15T00:47:53.066ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f567c90b-a1be-48f9-8bd0-c456c03bfa2e", "content-length": "26", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
34682025-01-15T00:47:53.066ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34692025-01-15T00:47:53.068ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
34702025-01-15T00:47:53.097ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34712025-01-15T00:47:53.097ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c985d81-eebc-4f1a-8b03-8a8fe36bb0a7", "content-length": "691", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
34722025-01-15T00:47:53.097ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
34732025-01-15T00:47:53.097ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
34742025-01-15T00:47:53.097ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
34752025-01-15T00:47:53.099ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 491.900087ms iteration = 7 status = {}
34762025-01-15T00:47:53.103ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34772025-01-15T00:47:53.103ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34782025-01-15T00:47:53.103ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9dabeaf6-aed4-46b8-a2de-6a2159158caa", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
34792025-01-15T00:47:53.105ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 498.142587ms iteration = 7 status = {}
34802025-01-15T00:47:53.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = bf1fd189-7771-4f7e-88ba-9f68a863a3e0 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
34812025-01-15T00:47:53.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = bf1fd189-7771-4f7e-88ba-9f68a863a3e0 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
34822025-01-15T00:47:53.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = bf1fd189-7771-4f7e-88ba-9f68a863a3e0 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
34832025-01-15T00:47:53.241ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
34842025-01-15T00:47:53.242ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "caac27d1-3873-4e7a-b7a2-25ae388033b7", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34852025-01-15T00:47:53.242ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34862025-01-15T00:47:53.244ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d704804c-9d37-4d3b-b6c2-7ae7759ef4ce", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34872025-01-15T00:47:53.244ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34882025-01-15T00:47:53.244ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34892025-01-15T00:47:53.245ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
34902025-01-15T00:47:53.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 642.215349ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34912025-01-15T00:47:53.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 939ea47c-eebd-4d29-9795-522bcaab7a77 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
34922025-01-15T00:47:53.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 939ea47c-eebd-4d29-9795-522bcaab7a77 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
34932025-01-15T00:47:53.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1578 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 939ea47c-eebd-4d29-9795-522bcaab7a77 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
34942025-01-15T00:47:53.305ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34952025-01-15T00:47:53.305ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f5f3a973-c5af-4da7-a9a3-5a9f6fc80f68", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34962025-01-15T00:47:53.305ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34972025-01-15T00:47:53.307ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "98d0c2ea-0d95-46cd-a417-81e6d7e375b2", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34982025-01-15T00:47:53.307ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34992025-01-15T00:47:53.309ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "81c239c4-160d-4fc0-a0aa-78301f6a4c55", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
35002025-01-15T00:47:53.309ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
35012025-01-15T00:47:53.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35022025-01-15T00:47:53.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35032025-01-15T00:47:53.311ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
35042025-01-15T00:47:53.311ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 708.117858ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
35052025-01-15T00:47:53.313ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
35062025-01-15T00:47:53.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35072025-01-15T00:47:53.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35082025-01-15T00:47:53.321ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35092025-01-15T00:47:53.321ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "73239667-5db3-4423-bbd1-af17c927d11f", "content-length": "134", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
35102025-01-15T00:47:53.321ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
35112025-01-15T00:47:53.321ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
35122025-01-15T00:47:53.321ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
35132025-01-15T00:47:53.321ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35142025-01-15T00:47:53.321ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35152025-01-15T00:47:53.321ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35162025-01-15T00:47:53.321ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35172025-01-15T00:47:53.321ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35182025-01-15T00:47:53.322ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
35192025-01-15T00:47:53.322ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
35202025-01-15T00:47:53.322ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
35212025-01-15T00:47:53.322ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35222025-01-15T00:47:53.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35232025-01-15T00:47:53.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35242025-01-15T00:47:53.324ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "74e17d2c-7d65-4474-8f71-58a557e99133", "content-length": "2", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
35252025-01-15T00:47:53.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35262025-01-15T00:47:53.324ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7197b27-c12a-47f0-bd48-0e1581119d5b", "content-length": "51", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
35272025-01-15T00:47:53.324ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
35282025-01-15T00:47:53.324ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35292025-01-15T00:47:53.419ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6e8168d2-1a11-465e-9b75-6e3ad4386439", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
35302025-01-15T00:47:53.419ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
35312025-01-15T00:47:53.419ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35322025-01-15T00:47:53.419ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "27ab4d0a-92b2-4f07-a2a8-543d08848d48", "content-length": "682", "date": "Wed, 15 Jan 2025 00:47:52 GMT"} })
35332025-01-15T00:47:53.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35342025-01-15T00:47:53.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35352025-01-15T00:47:53.422ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35362025-01-15T00:47:53.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35372025-01-15T00:47:53.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35382025-01-15T00:47:53.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35392025-01-15T00:47:53.427ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35402025-01-15T00:47:53.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35412025-01-15T00:47:53.435ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 830.728018ms iteration = 7 status = {}
35422025-01-15T00:47:54.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77e162bb-c371-455d-9ec6-3cfc9b9f5c45 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35432025-01-15T00:47:54.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77e162bb-c371-455d-9ec6-3cfc9b9f5c45 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35442025-01-15T00:47:54.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2265 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77e162bb-c371-455d-9ec6-3cfc9b9f5c45 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35452025-01-15T00:47:54.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 8046ebf6-ef2b-4e2c-9e66-aa6393e1dbed response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
35462025-01-15T00:47:55.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 81f335bf-a4e8-4be5-b34d-436f01691af3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35472025-01-15T00:47:55.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 81f335bf-a4e8-4be5-b34d-436f01691af3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35482025-01-15T00:47:55.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 81f335bf-a4e8-4be5-b34d-436f01691af3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35492025-01-15T00:47:56.319ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d8b39b98-9cdf-4f69-be42-6d4cdca65ac1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35502025-01-15T00:47:56.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d8b39b98-9cdf-4f69-be42-6d4cdca65ac1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35512025-01-15T00:47:56.321ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d8b39b98-9cdf-4f69-be42-6d4cdca65ac1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35522025-01-15T00:47:57.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f027c85e-0451-4250-b8bc-431fc2d7c104 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35532025-01-15T00:47:57.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f027c85e-0451-4250-b8bc-431fc2d7c104 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35542025-01-15T00:47:57.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f027c85e-0451-4250-b8bc-431fc2d7c104 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35552025-01-15T00:47:58.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 268df80a-83ea-4b8c-a0bb-dd35e400ee47 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35562025-01-15T00:47:58.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 268df80a-83ea-4b8c-a0bb-dd35e400ee47 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35572025-01-15T00:47:58.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1828 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 268df80a-83ea-4b8c-a0bb-dd35e400ee47 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35582025-01-15T00:47:59.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 707b52e5-4ba9-40ab-baf2-9e717752c893 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35592025-01-15T00:47:59.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 707b52e5-4ba9-40ab-baf2-9e717752c893 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35602025-01-15T00:47:59.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2772 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 707b52e5-4ba9-40ab-baf2-9e717752c893 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35612025-01-15T00:48:00.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 22566de2-f922-463d-aec2-299f278a41e7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35622025-01-15T00:48:00.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 22566de2-f922-463d-aec2-299f278a41e7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35632025-01-15T00:48:00.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 22566de2-f922-463d-aec2-299f278a41e7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35642025-01-15T00:48:01.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4481c25c-0996-4d9c-b781-4bff405f8904 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35652025-01-15T00:48:01.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4481c25c-0996-4d9c-b781-4bff405f8904 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35662025-01-15T00:48:01.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4481c25c-0996-4d9c-b781-4bff405f8904 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35672025-01-15T00:48:02.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7fefffc4-9c76-4086-93f0-1c1db6928e2a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35682025-01-15T00:48:02.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7fefffc4-9c76-4086-93f0-1c1db6928e2a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35692025-01-15T00:48:02.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7fefffc4-9c76-4086-93f0-1c1db6928e2a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35702025-01-15T00:48:02.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
35712025-01-15T00:48:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35722025-01-15T00:48:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35732025-01-15T00:48:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35742025-01-15T00:48:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
35752025-01-15T00:48:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35762025-01-15T00:48:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35772025-01-15T00:48:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35782025-01-15T00:48:02.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35792025-01-15T00:48:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35802025-01-15T00:48:02.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35812025-01-15T00:48:02.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35822025-01-15T00:48:02.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35832025-01-15T00:48:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35842025-01-15T00:48:02.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35852025-01-15T00:48:02.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.811053ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35862025-01-15T00:48:02.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
35872025-01-15T00:48:02.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35882025-01-15T00:48:02.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35892025-01-15T00:48:02.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
35902025-01-15T00:48:02.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.970291ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
35912025-01-15T00:48:03.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b467a6b3-b9d4-4721-a40d-a5e0a163235e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35922025-01-15T00:48:03.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b467a6b3-b9d4-4721-a40d-a5e0a163235e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35932025-01-15T00:48:03.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b467a6b3-b9d4-4721-a40d-a5e0a163235e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
35942025-01-15T00:48:04.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 3fc28791-7c71-4918-8095-421621c2c0ea roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
35952025-01-15T00:48:04.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 3fc28791-7c71-4918-8095-421621c2c0ea resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
35962025-01-15T00:48:04.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3102 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 3fc28791-7c71-4918-8095-421621c2c0ea response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
35972025-01-15T00:48:04.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = c6878510-f277-47a0-a341-b94c09a0e01d roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
35982025-01-15T00:48:04.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = c6878510-f277-47a0-a341-b94c09a0e01d resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
35992025-01-15T00:48:04.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = c6878510-f277-47a0-a341-b94c09a0e01d response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
36002025-01-15T00:48:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 532 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 46061bd2-26c4-4232-9281-4f6d451159a6 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
36012025-01-15T00:48:04.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fb661671-18ba-4b70-b874-fd8fb15cad66 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36022025-01-15T00:48:04.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fb661671-18ba-4b70-b874-fd8fb15cad66 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36032025-01-15T00:48:04.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fb661671-18ba-4b70-b874-fd8fb15cad66 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36042025-01-15T00:48:05.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 559ad83b-8aa6-4006-ae49-c091920d91f0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36052025-01-15T00:48:05.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 559ad83b-8aa6-4006-ae49-c091920d91f0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36062025-01-15T00:48:05.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2607 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 559ad83b-8aa6-4006-ae49-c091920d91f0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36072025-01-15T00:48:06.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 55fe6941-da74-42a0-b48b-a6f68c0970ad roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36082025-01-15T00:48:06.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 55fe6941-da74-42a0-b48b-a6f68c0970ad resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36092025-01-15T00:48:06.536ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1910 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 55fe6941-da74-42a0-b48b-a6f68c0970ad response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36102025-01-15T00:48:07.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f24a62c6-da42-470b-a38d-ada75132cb99 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36112025-01-15T00:48:07.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f24a62c6-da42-470b-a38d-ada75132cb99 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36122025-01-15T00:48:07.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1831 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f24a62c6-da42-470b-a38d-ada75132cb99 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36132025-01-15T00:48:08.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00779050-6b23-4f7f-bbcd-9bc78945819c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36142025-01-15T00:48:08.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00779050-6b23-4f7f-bbcd-9bc78945819c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36152025-01-15T00:48:08.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00779050-6b23-4f7f-bbcd-9bc78945819c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36162025-01-15T00:48:09.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 21ba81b8-2202-437b-8fac-4a817222592f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36172025-01-15T00:48:09.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 21ba81b8-2202-437b-8fac-4a817222592f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36182025-01-15T00:48:09.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 21ba81b8-2202-437b-8fac-4a817222592f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36192025-01-15T00:48:10.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d14f18a3-343c-4576-87f5-481479dc07fd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36202025-01-15T00:48:10.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d14f18a3-343c-4576-87f5-481479dc07fd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36212025-01-15T00:48:10.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2181 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d14f18a3-343c-4576-87f5-481479dc07fd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36222025-01-15T00:48:11.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 67e8eabb-3df7-45ba-a246-cf6bfa97ddb6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36232025-01-15T00:48:11.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 67e8eabb-3df7-45ba-a246-cf6bfa97ddb6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36242025-01-15T00:48:11.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 67e8eabb-3df7-45ba-a246-cf6bfa97ddb6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36252025-01-15T00:48:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
36262025-01-15T00:48:12.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36272025-01-15T00:48:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36282025-01-15T00:48:12.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36292025-01-15T00:48:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36302025-01-15T00:48:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36312025-01-15T00:48:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36322025-01-15T00:48:12.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
36332025-01-15T00:48:12.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36342025-01-15T00:48:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36352025-01-15T00:48:12.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36362025-01-15T00:48:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36372025-01-15T00:48:12.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36382025-01-15T00:48:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36392025-01-15T00:48:12.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36402025-01-15T00:48:12.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.217541ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36412025-01-15T00:48:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
36422025-01-15T00:48:12.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36432025-01-15T00:48:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36442025-01-15T00:48:12.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
36452025-01-15T00:48:12.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.582254ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
36462025-01-15T00:48:12.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = edfd5c01-e018-45cc-badf-d4dd4136f755 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36472025-01-15T00:48:12.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = edfd5c01-e018-45cc-badf-d4dd4136f755 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36482025-01-15T00:48:12.665ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1616 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = edfd5c01-e018-45cc-badf-d4dd4136f755 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36492025-01-15T00:48:13.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = be7e04fa-2511-4b23-bb3a-ccee2f768501 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36502025-01-15T00:48:13.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = be7e04fa-2511-4b23-bb3a-ccee2f768501 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36512025-01-15T00:48:13.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = be7e04fa-2511-4b23-bb3a-ccee2f768501 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36522025-01-15T00:48:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 609 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = e7e93ff7-369d-4108-a479-697055eac6c7 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
36532025-01-15T00:48:14.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f820052b-f229-46be-9954-2ab6db0d12eb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36542025-01-15T00:48:14.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f820052b-f229-46be-9954-2ab6db0d12eb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36552025-01-15T00:48:14.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f820052b-f229-46be-9954-2ab6db0d12eb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36562025-01-15T00:48:15.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e0f0d80f-81c1-4628-8f5d-8e03ab319fcf roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36572025-01-15T00:48:15.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e0f0d80f-81c1-4628-8f5d-8e03ab319fcf resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36582025-01-15T00:48:15.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e0f0d80f-81c1-4628-8f5d-8e03ab319fcf response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36592025-01-15T00:48:16.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f6c1600c-0897-44ec-b7f5-cc639900340d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36602025-01-15T00:48:16.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f6c1600c-0897-44ec-b7f5-cc639900340d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36612025-01-15T00:48:16.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f6c1600c-0897-44ec-b7f5-cc639900340d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36622025-01-15T00:48:17.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ef4f9c1-1654-4cb8-a28d-799186bf2dcd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36632025-01-15T00:48:17.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ef4f9c1-1654-4cb8-a28d-799186bf2dcd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36642025-01-15T00:48:17.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1767 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ef4f9c1-1654-4cb8-a28d-799186bf2dcd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36652025-01-15T00:48:18.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6655f80-6bfc-4b8e-aac2-e3d1a75f91a3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36662025-01-15T00:48:18.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6655f80-6bfc-4b8e-aac2-e3d1a75f91a3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36672025-01-15T00:48:18.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6655f80-6bfc-4b8e-aac2-e3d1a75f91a3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36682025-01-15T00:48:19.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b549453-0d4c-4c21-8b75-c54ccf62f39b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36692025-01-15T00:48:19.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b549453-0d4c-4c21-8b75-c54ccf62f39b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36702025-01-15T00:48:19.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b549453-0d4c-4c21-8b75-c54ccf62f39b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36712025-01-15T00:48:20.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b66431ea-8aa7-4437-8fc1-4ea4eba852e1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36722025-01-15T00:48:20.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b66431ea-8aa7-4437-8fc1-4ea4eba852e1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36732025-01-15T00:48:20.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1867 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b66431ea-8aa7-4437-8fc1-4ea4eba852e1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36742025-01-15T00:48:21.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7ab30e1a-fd52-4695-aee5-20ca8ee4eb63 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36752025-01-15T00:48:21.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7ab30e1a-fd52-4695-aee5-20ca8ee4eb63 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36762025-01-15T00:48:21.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12721 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7ab30e1a-fd52-4695-aee5-20ca8ee4eb63 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
36772025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
36782025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36792025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
36802025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
36812025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36822025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
36832025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36842025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36852025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36862025-01-15T00:48:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36872025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
36882025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
36892025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
36902025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36912025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
36922025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36932025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36942025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36952025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36962025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36972025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36982025-01-15T00:48:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36992025-01-15T00:48:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1122, tv_nsec: 936048685 } })
37002025-01-15T00:48:22.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37012025-01-15T00:48:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
37022025-01-15T00:48:22.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1122, tv_nsec: 936892881 } })
37032025-01-15T00:48:22.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
37042025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.998126ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37052025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
37062025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37072025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
37082025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37092025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37102025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
37112025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37122025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
37132025-01-15T00:48:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
37142025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37152025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
37162025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37172025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
37182025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37192025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37202025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37212025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37222025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37232025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37242025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37252025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37262025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37272025-01-15T00:48:22.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37282025-01-15T00:48:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
37292025-01-15T00:48:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
37302025-01-15T00:48:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
37312025-01-15T00:48:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37322025-01-15T00:48:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
37332025-01-15T00:48:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37342025-01-15T00:48:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
37352025-01-15T00:48:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37362025-01-15T00:48:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37372025-01-15T00:48:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37382025-01-15T00:48:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37392025-01-15T00:48:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37402025-01-15T00:48:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37412025-01-15T00:48:22.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37422025-01-15T00:48:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37432025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37442025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37452025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37462025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37472025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37482025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37492025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37502025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37512025-01-15T00:48:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37522025-01-15T00:48:22.612ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37532025-01-15T00:48:22.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37542025-01-15T00:48:22.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37552025-01-15T00:48:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37562025-01-15T00:48:22.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37572025-01-15T00:48:22.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37582025-01-15T00:48:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37592025-01-15T00:48:22.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37602025-01-15T00:48:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37612025-01-15T00:48:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37622025-01-15T00:48:22.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37632025-01-15T00:48:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37642025-01-15T00:48:22.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37652025-01-15T00:48:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37662025-01-15T00:48:22.619ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.672296ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
37672025-01-15T00:48:22.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37682025-01-15T00:48:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37692025-01-15T00:48:22.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37702025-01-15T00:48:22.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37712025-01-15T00:48:22.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 13.875997ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37722025-01-15T00:48:22.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37732025-01-15T00:48:22.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37742025-01-15T00:48:22.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1122, tv_nsec: 952078593 } })
37752025-01-15T00:48:22.622ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
37762025-01-15T00:48:22.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37772025-01-15T00:48:22.624ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37782025-01-15T00:48:22.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37792025-01-15T00:48:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
37802025-01-15T00:48:22.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37812025-01-15T00:48:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
37822025-01-15T00:48:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37832025-01-15T00:48:22.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37842025-01-15T00:48:22.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37852025-01-15T00:48:22.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37862025-01-15T00:48:22.647ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
37872025-01-15T00:48:22.647ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.392554ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
37882025-01-15T00:48:22.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37892025-01-15T00:48:22.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37902025-01-15T00:48:22.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37912025-01-15T00:48:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37922025-01-15T00:48:22.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37932025-01-15T00:48:22.655ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37942025-01-15T00:48:22.655ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37952025-01-15T00:48:22.655ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37962025-01-15T00:48:22.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37972025-01-15T00:48:22.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37982025-01-15T00:48:22.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37992025-01-15T00:48:22.657ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38002025-01-15T00:48:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38012025-01-15T00:48:22.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.319349ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
38022025-01-15T00:48:22.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
38032025-01-15T00:48:22.659ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38042025-01-15T00:48:22.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38052025-01-15T00:48:22.660ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38062025-01-15T00:48:22.661ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 51.95688ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38072025-01-15T00:48:22.663ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38082025-01-15T00:48:22.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38092025-01-15T00:48:22.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38102025-01-15T00:48:22.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38112025-01-15T00:48:22.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38122025-01-15T00:48:22.664ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 59.21957ms iteration = 8 status = 0
38132025-01-15T00:48:22.668ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38142025-01-15T00:48:22.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38152025-01-15T00:48:22.671ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38162025-01-15T00:48:22.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38172025-01-15T00:48:22.673ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38182025-01-15T00:48:22.673ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
38192025-01-15T00:48:22.673ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.058641ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
38202025-01-15T00:48:22.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
38212025-01-15T00:48:22.676ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38222025-01-15T00:48:22.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38232025-01-15T00:48:22.691ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38242025-01-15T00:48:22.691ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38252025-01-15T00:48:22.691ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38262025-01-15T00:48:22.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38272025-01-15T00:48:22.700ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.811486ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38282025-01-15T00:48:22.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 92.178944ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
38292025-01-15T00:48:22.706ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
38302025-01-15T00:48:22.706ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38312025-01-15T00:48:22.706ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bea14f52-72eb-4261-a828-276075827e97", "content-length": "26", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
38322025-01-15T00:48:22.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38332025-01-15T00:48:22.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38342025-01-15T00:48:22.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
38352025-01-15T00:48:22.709ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38362025-01-15T00:48:22.709ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f62406c7-4f52-4e6d-b838-7ed34ed176bb", "content-length": "26", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
38372025-01-15T00:48:22.709ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38382025-01-15T00:48:22.711ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38392025-01-15T00:48:22.736ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
38402025-01-15T00:48:22.736ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38412025-01-15T00:48:22.737ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23a24017-0de6-4b47-bf39-f2ea829fcca4", "content-length": "26", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
38422025-01-15T00:48:22.737ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38432025-01-15T00:48:22.738ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
38442025-01-15T00:48:22.739ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 133.623142ms iteration = 10 status = {"physical_disks_added":0}
38452025-01-15T00:48:22.741ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38462025-01-15T00:48:22.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38472025-01-15T00:48:22.848ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38482025-01-15T00:48:22.848ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38492025-01-15T00:48:22.848ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f2cce1c-18f9-4d71-8799-79613d98bd05", "content-length": "372", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
38502025-01-15T00:48:22.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38512025-01-15T00:48:22.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38522025-01-15T00:48:22.849ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 245.955504ms iteration = 8 status = {}
38532025-01-15T00:48:22.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38542025-01-15T00:48:22.852ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38552025-01-15T00:48:22.852ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38562025-01-15T00:48:22.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38572025-01-15T00:48:22.854ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38582025-01-15T00:48:22.856ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38592025-01-15T00:48:22.856ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38602025-01-15T00:48:22.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38612025-01-15T00:48:22.875ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38622025-01-15T00:48:22.875ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfdb0bb8-75bd-4f59-8050-6eea4bc3e740", "content-length": "1", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
38632025-01-15T00:48:22.876ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38642025-01-15T00:48:22.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38652025-01-15T00:48:22.878ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 275.621485ms iteration = 8 status = null
38662025-01-15T00:48:22.879ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
38672025-01-15T00:48:22.879ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 274.225058ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
38682025-01-15T00:48:22.879ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38692025-01-15T00:48:22.879ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38702025-01-15T00:48:22.879ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 272.396552ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38712025-01-15T00:48:22.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f44b7813-0c04-44e4-926d-58414fa64258 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
38722025-01-15T00:48:22.888ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f44b7813-0c04-44e4-926d-58414fa64258 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
38732025-01-15T00:48:22.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2832 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f44b7813-0c04-44e4-926d-58414fa64258 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
38742025-01-15T00:48:22.893ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
38752025-01-15T00:48:22.893ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38762025-01-15T00:48:22.898ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7eff9699-b0a2-4a4f-8e4d-b19c74d47c8b", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
38772025-01-15T00:48:22.898ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38782025-01-15T00:48:22.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38792025-01-15T00:48:22.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38802025-01-15T00:48:22.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38812025-01-15T00:48:22.903ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38822025-01-15T00:48:22.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38832025-01-15T00:48:22.906ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38842025-01-15T00:48:22.906ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38852025-01-15T00:48:22.907ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "664bd16f-a845-4a6f-9d58-109c0c9d15cd", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
38862025-01-15T00:48:22.908ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 301.165626ms iteration = 8 status = {}
38872025-01-15T00:48:22.943ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38882025-01-15T00:48:22.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38892025-01-15T00:48:22.945ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
38902025-01-15T00:48:22.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38912025-01-15T00:48:22.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38922025-01-15T00:48:22.958ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38932025-01-15T00:48:22.959ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0550d7d-d880-454c-906c-7f02544fc827", "content-length": "691", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
38942025-01-15T00:48:22.959ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
38952025-01-15T00:48:22.959ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
38962025-01-15T00:48:22.959ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
38972025-01-15T00:48:22.960ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 352.990543ms iteration = 8 status = {}
38982025-01-15T00:48:22.972ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38992025-01-15T00:48:22.973ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f5e8157-81bb-4a23-b427-30d0040a19a2", "content-length": "134", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
39002025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
39012025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
39022025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
39032025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
39042025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39052025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39062025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39072025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39082025-01-15T00:48:22.973ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
39092025-01-15T00:48:22.974ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
39102025-01-15T00:48:22.974ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
39112025-01-15T00:48:22.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39122025-01-15T00:48:22.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39132025-01-15T00:48:22.976ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
39142025-01-15T00:48:22.976ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2fe6e02-ff73-4bc3-8e0c-a933f4a27250", "content-length": "2", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
39152025-01-15T00:48:22.976ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
39162025-01-15T00:48:22.976ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c50af972-f069-4670-9094-73dffc23b412", "content-length": "51", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
39172025-01-15T00:48:22.976ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
39182025-01-15T00:48:22.976ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
39192025-01-15T00:48:23.069ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c138f40d-cfc4-446f-85cf-dfea7d8b7e1f", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
39202025-01-15T00:48:23.069ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
39212025-01-15T00:48:23.069ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
39222025-01-15T00:48:23.072ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e2a3b21-155e-4f87-ac7e-0f547d40b5d3", "content-length": "682", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
39232025-01-15T00:48:23.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39242025-01-15T00:48:23.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39252025-01-15T00:48:23.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39262025-01-15T00:48:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39272025-01-15T00:48:23.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39282025-01-15T00:48:23.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39292025-01-15T00:48:23.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39302025-01-15T00:48:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39312025-01-15T00:48:23.087ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 482.497296ms iteration = 8 status = {}
39322025-01-15T00:48:23.148ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
39332025-01-15T00:48:23.148ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
39342025-01-15T00:48:23.178ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
39352025-01-15T00:48:23.178ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:44440
39362025-01-15T00:48:23.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:44440 req_id = 4c92cb75-8ed7-4d17-adfa-ffcb5a5a6198 roles = RoleSet { roles: {} } uri = /metrics/producers
39372025-01-15T00:48:23.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:44440 req_id = 4c92cb75-8ed7-4d17-adfa-ffcb5a5a6198 resource = Database result = Ok(()) uri = /metrics/producers
39382025-01-15T00:48:23.236ZINFOnexus: assigned collector to new producer collector_id = dee7453b-558a-4d94-b6a0-8b27cb27f002 file = nexus/src/app/oximeter.rs:76 producer_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
39392025-01-15T00:48:23.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58182 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:44440 req_id = 4c92cb75-8ed7-4d17-adfa-ffcb5a5a6198 response_code = 201 uri = /metrics/producers
39402025-01-15T00:48:23.236ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4c92cb75-8ed7-4d17-adfa-ffcb5a5a6198", "content-length": "41", "date": "Wed, 15 Jan 2025 00:48:22 GMT"} })
39412025-01-15T00:48:23.238ZDEBGnexus (producer-registration-task): registered with nexus successfully
39422025-01-15T00:48:23.238ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
39432025-01-15T00:48:23.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 18145aa7-d5cd-4045-89e3-71173878f46f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
39442025-01-15T00:48:23.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 18145aa7-d5cd-4045-89e3-71173878f46f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
39452025-01-15T00:48:23.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3412 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 18145aa7-d5cd-4045-89e3-71173878f46f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
39462025-01-15T00:48:23.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60e9d3b1-c772-443a-ae71-73d4aa146f52 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39472025-01-15T00:48:23.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60e9d3b1-c772-443a-ae71-73d4aa146f52 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39482025-01-15T00:48:23.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2001 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60e9d3b1-c772-443a-ae71-73d4aa146f52 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39492025-01-15T00:48:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = d710f68a-225d-4186-91a8-e11373ff6260 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
39502025-01-15T00:48:24.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5de66244-fea3-4034-9a9b-e7e6e0964fa1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39512025-01-15T00:48:24.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5de66244-fea3-4034-9a9b-e7e6e0964fa1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39522025-01-15T00:48:24.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5de66244-fea3-4034-9a9b-e7e6e0964fa1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39532025-01-15T00:48:25.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6825866-52b0-43f8-8e9a-e4cddfb8b744 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39542025-01-15T00:48:25.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6825866-52b0-43f8-8e9a-e4cddfb8b744 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39552025-01-15T00:48:25.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6825866-52b0-43f8-8e9a-e4cddfb8b744 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39562025-01-15T00:48:26.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35f4e8f0-7bfc-49d7-b04e-b94d8cd8a88a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39572025-01-15T00:48:26.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35f4e8f0-7bfc-49d7-b04e-b94d8cd8a88a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39582025-01-15T00:48:26.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35f4e8f0-7bfc-49d7-b04e-b94d8cd8a88a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39592025-01-15T00:48:27.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = efc54635-f2ce-4e91-a5c3-1ca95cfa88c3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39602025-01-15T00:48:27.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = efc54635-f2ce-4e91-a5c3-1ca95cfa88c3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39612025-01-15T00:48:27.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1718 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = efc54635-f2ce-4e91-a5c3-1ca95cfa88c3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39622025-01-15T00:48:29.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 769d3554-8173-47ff-b55e-1b2e2990fda0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39632025-01-15T00:48:29.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 769d3554-8173-47ff-b55e-1b2e2990fda0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39642025-01-15T00:48:29.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3007 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 769d3554-8173-47ff-b55e-1b2e2990fda0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39652025-01-15T00:48:30.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88cdddc0-a972-4e7f-87a8-6491ad9b0045 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39662025-01-15T00:48:30.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88cdddc0-a972-4e7f-87a8-6491ad9b0045 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39672025-01-15T00:48:30.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88cdddc0-a972-4e7f-87a8-6491ad9b0045 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39682025-01-15T00:48:31.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b09d3b3c-e665-4b68-ac57-5ccecb0ce46d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39692025-01-15T00:48:31.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b09d3b3c-e665-4b68-ac57-5ccecb0ce46d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39702025-01-15T00:48:31.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b09d3b3c-e665-4b68-ac57-5ccecb0ce46d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39712025-01-15T00:48:32.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e4717d9-a42f-427f-b6c2-26e3c6f80ab8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39722025-01-15T00:48:32.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e4717d9-a42f-427f-b6c2-26e3c6f80ab8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39732025-01-15T00:48:32.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1829 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e4717d9-a42f-427f-b6c2-26e3c6f80ab8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39742025-01-15T00:48:32.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
39752025-01-15T00:48:32.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39762025-01-15T00:48:32.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39772025-01-15T00:48:32.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39782025-01-15T00:48:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39792025-01-15T00:48:32.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39802025-01-15T00:48:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39812025-01-15T00:48:32.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
39822025-01-15T00:48:32.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39832025-01-15T00:48:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39842025-01-15T00:48:32.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39852025-01-15T00:48:32.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39862025-01-15T00:48:32.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39872025-01-15T00:48:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
39882025-01-15T00:48:32.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39892025-01-15T00:48:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39902025-01-15T00:48:32.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
39912025-01-15T00:48:32.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.507033ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
39922025-01-15T00:48:32.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39932025-01-15T00:48:32.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39942025-01-15T00:48:32.665ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.499017ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39952025-01-15T00:48:33.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2d3deb1-9fe5-4d91-98a7-ff9a7d77fe0f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39962025-01-15T00:48:33.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2d3deb1-9fe5-4d91-98a7-ff9a7d77fe0f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39972025-01-15T00:48:33.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2395 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2d3deb1-9fe5-4d91-98a7-ff9a7d77fe0f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39982025-01-15T00:48:34.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2dc46ac6-d263-4d72-aeea-59f5217fd5ad roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
39992025-01-15T00:48:34.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2dc46ac6-d263-4d72-aeea-59f5217fd5ad resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40002025-01-15T00:48:34.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2dc46ac6-d263-4d72-aeea-59f5217fd5ad response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40012025-01-15T00:48:34.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 600d5934-acc6-42eb-bef3-abd8b8430f67 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
40022025-01-15T00:48:34.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 600d5934-acc6-42eb-bef3-abd8b8430f67 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
40032025-01-15T00:48:34.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2801 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 600d5934-acc6-42eb-bef3-abd8b8430f67 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
40042025-01-15T00:48:34.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 4bc1992f-7caa-4b14-b1d8-a8723cd4c65e roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
40052025-01-15T00:48:34.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 4bc1992f-7caa-4b14-b1d8-a8723cd4c65e resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
40062025-01-15T00:48:34.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3052 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42636 req_id = 4bc1992f-7caa-4b14-b1d8-a8723cd4c65e response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
40072025-01-15T00:48:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 564 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 322fe3d1-f3eb-4f3e-9ce1-9b8f33f4a9c9 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
40082025-01-15T00:48:35.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eccdb130-3a6c-43cd-8147-20e8e2ea1177 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40092025-01-15T00:48:35.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eccdb130-3a6c-43cd-8147-20e8e2ea1177 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40102025-01-15T00:48:35.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1723 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eccdb130-3a6c-43cd-8147-20e8e2ea1177 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40112025-01-15T00:48:36.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5cbb428b-9cf3-4807-a19b-f4d001050c84 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40122025-01-15T00:48:36.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5cbb428b-9cf3-4807-a19b-f4d001050c84 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40132025-01-15T00:48:36.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5cbb428b-9cf3-4807-a19b-f4d001050c84 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40142025-01-15T00:48:37.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a48c08e-fccb-4146-9c64-0e70a460a398 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40152025-01-15T00:48:37.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a48c08e-fccb-4146-9c64-0e70a460a398 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40162025-01-15T00:48:37.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a48c08e-fccb-4146-9c64-0e70a460a398 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40172025-01-15T00:48:38.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a18a1687-f46e-4509-9aba-d171ed882b4a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40182025-01-15T00:48:38.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a18a1687-f46e-4509-9aba-d171ed882b4a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40192025-01-15T00:48:38.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a18a1687-f46e-4509-9aba-d171ed882b4a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40202025-01-15T00:48:39.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 297ea6cc-a907-4d86-8137-cdab68cb7ce4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40212025-01-15T00:48:39.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 297ea6cc-a907-4d86-8137-cdab68cb7ce4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40222025-01-15T00:48:39.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 297ea6cc-a907-4d86-8137-cdab68cb7ce4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40232025-01-15T00:48:40.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 44f1e2b8-46c2-400c-8e66-cbfab2ad4c60 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40242025-01-15T00:48:40.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 44f1e2b8-46c2-400c-8e66-cbfab2ad4c60 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40252025-01-15T00:48:40.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1542 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 44f1e2b8-46c2-400c-8e66-cbfab2ad4c60 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40262025-01-15T00:48:41.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2fcc445b-e276-4761-92c3-fea46aff0ee1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40272025-01-15T00:48:41.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2fcc445b-e276-4761-92c3-fea46aff0ee1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40282025-01-15T00:48:41.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2480 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2fcc445b-e276-4761-92c3-fea46aff0ee1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40292025-01-15T00:48:42.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1234baec-8c8e-4a2b-b0cb-627a4b4fa44f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40302025-01-15T00:48:42.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1234baec-8c8e-4a2b-b0cb-627a4b4fa44f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40312025-01-15T00:48:42.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1234baec-8c8e-4a2b-b0cb-627a4b4fa44f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40322025-01-15T00:48:42.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
40332025-01-15T00:48:42.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40342025-01-15T00:48:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40352025-01-15T00:48:42.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
40362025-01-15T00:48:42.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40372025-01-15T00:48:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40382025-01-15T00:48:42.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40392025-01-15T00:48:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40402025-01-15T00:48:42.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40412025-01-15T00:48:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40422025-01-15T00:48:42.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40432025-01-15T00:48:42.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40442025-01-15T00:48:42.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40452025-01-15T00:48:42.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40462025-01-15T00:48:42.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.794554ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40472025-01-15T00:48:42.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40482025-01-15T00:48:42.645ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
40492025-01-15T00:48:42.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40502025-01-15T00:48:42.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40512025-01-15T00:48:42.657ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
40522025-01-15T00:48:42.657ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.792904ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
40532025-01-15T00:48:43.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0580b3aa-2e19-4fd1-9aee-1489ee0dbcf2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40542025-01-15T00:48:43.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0580b3aa-2e19-4fd1-9aee-1489ee0dbcf2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40552025-01-15T00:48:43.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0580b3aa-2e19-4fd1-9aee-1489ee0dbcf2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40562025-01-15T00:48:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = e9a8052b-6d0f-499a-b2bd-3c83d208b237 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
40572025-01-15T00:48:44.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ad5aeda3-f9f5-4986-a930-112f78790c9e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40582025-01-15T00:48:44.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ad5aeda3-f9f5-4986-a930-112f78790c9e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40592025-01-15T00:48:44.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ad5aeda3-f9f5-4986-a930-112f78790c9e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40602025-01-15T00:48:45.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 173021ec-1f1d-4e92-8d43-080997dd5d3d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40612025-01-15T00:48:45.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 173021ec-1f1d-4e92-8d43-080997dd5d3d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40622025-01-15T00:48:45.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2100 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 173021ec-1f1d-4e92-8d43-080997dd5d3d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40632025-01-15T00:48:46.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = faa19749-f253-4a00-b2ed-785963884782 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40642025-01-15T00:48:46.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = faa19749-f253-4a00-b2ed-785963884782 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40652025-01-15T00:48:46.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1930 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = faa19749-f253-4a00-b2ed-785963884782 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40662025-01-15T00:48:47.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = af7377c7-4e7c-411b-aa11-5a685edc16a8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40672025-01-15T00:48:47.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = af7377c7-4e7c-411b-aa11-5a685edc16a8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40682025-01-15T00:48:47.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1981 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = af7377c7-4e7c-411b-aa11-5a685edc16a8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40692025-01-15T00:48:48.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9de3b643-9132-40ac-8ff7-e11a67e95c53 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40702025-01-15T00:48:48.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9de3b643-9132-40ac-8ff7-e11a67e95c53 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40712025-01-15T00:48:48.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9de3b643-9132-40ac-8ff7-e11a67e95c53 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40722025-01-15T00:48:49.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1de11cb3-3408-40ca-bce5-4f596a63757b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40732025-01-15T00:48:49.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1de11cb3-3408-40ca-bce5-4f596a63757b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40742025-01-15T00:48:49.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1de11cb3-3408-40ca-bce5-4f596a63757b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40752025-01-15T00:48:50.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f9d4749-cbed-45a0-94fd-0487f5b74ba4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40762025-01-15T00:48:50.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f9d4749-cbed-45a0-94fd-0487f5b74ba4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40772025-01-15T00:48:50.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f9d4749-cbed-45a0-94fd-0487f5b74ba4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40782025-01-15T00:48:51.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a5c6cc23-a777-4bec-9dbe-6f6f73a6b5f9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40792025-01-15T00:48:51.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a5c6cc23-a777-4bec-9dbe-6f6f73a6b5f9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40802025-01-15T00:48:51.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a5c6cc23-a777-4bec-9dbe-6f6f73a6b5f9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40812025-01-15T00:48:52.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1dd67ed2-85f6-4a52-bf20-a01a5c1fc840 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40822025-01-15T00:48:52.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1dd67ed2-85f6-4a52-bf20-a01a5c1fc840 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40832025-01-15T00:48:52.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1dd67ed2-85f6-4a52-bf20-a01a5c1fc840 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
40842025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
40852025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40862025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40872025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
40882025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
40892025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40902025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
40912025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
40922025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40932025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40942025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
40952025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
40962025-01-15T00:48:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
40972025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.93\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
40982025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
40992025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
41002025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
41012025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
41022025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
41032025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
41042025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41052025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
41062025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41072025-01-15T00:48:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:38:52.603224160 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
41082025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
41092025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41102025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41112025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41122025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41132025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41142025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41152025-01-15T00:48:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1152, tv_nsec: 933422374 } })
41162025-01-15T00:48:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41172025-01-15T00:48:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1152, tv_nsec: 933474315 } })
41182025-01-15T00:48:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
41192025-01-15T00:48:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 891.077\u{b5}s iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
41202025-01-15T00:48:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
41212025-01-15T00:48:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.01547ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
41222025-01-15T00:48:52.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41232025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41242025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
41252025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
41262025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41272025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41282025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
41292025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41302025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
41312025-01-15T00:48:52.605ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
41322025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
41332025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
41342025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41352025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41362025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41372025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41382025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
41392025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41402025-01-15T00:48:52.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41412025-01-15T00:48:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41422025-01-15T00:48:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41432025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.939976ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41442025-01-15T00:48:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1152, tv_nsec: 937050594 } })
41452025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
41462025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
41472025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
41482025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41492025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41502025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41512025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41522025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
41532025-01-15T00:48:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
41542025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
41552025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41562025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
41572025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
41582025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41592025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
41602025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41612025-01-15T00:48:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
41622025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41632025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41642025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41652025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41662025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41672025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41682025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41692025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41702025-01-15T00:48:52.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41712025-01-15T00:48:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41722025-01-15T00:48:52.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1152, tv_nsec: 938108845 } })
41732025-01-15T00:48:52.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
41742025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
41752025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
41762025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41772025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41782025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
41792025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41802025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
41812025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41822025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
41832025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41842025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
41852025-01-15T00:48:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41862025-01-15T00:48:52.609ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:38:52.603224160 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41872025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41882025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.779681ms iteration = 5 status = {"expiration":"2025-01-15T00:38:52.603224160Z","pruned":[]}
41892025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41912025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41922025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41932025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41942025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41952025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41962025-01-15T00:48:52.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41972025-01-15T00:48:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41982025-01-15T00:48:52.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41992025-01-15T00:48:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42002025-01-15T00:48:52.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42012025-01-15T00:48:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42022025-01-15T00:48:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42032025-01-15T00:48:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42042025-01-15T00:48:52.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42052025-01-15T00:48:52.617ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42062025-01-15T00:48:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
42072025-01-15T00:48:52.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42082025-01-15T00:48:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42092025-01-15T00:48:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42102025-01-15T00:48:52.625ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42112025-01-15T00:48:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42122025-01-15T00:48:52.628ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.625949ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
42132025-01-15T00:48:52.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42142025-01-15T00:48:52.630ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42152025-01-15T00:48:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42162025-01-15T00:48:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42172025-01-15T00:48:52.630ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1152, tv_nsec: 960710240 } })
42182025-01-15T00:48:52.631ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
42192025-01-15T00:48:52.658ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42202025-01-15T00:48:52.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42212025-01-15T00:48:52.661ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42222025-01-15T00:48:52.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42232025-01-15T00:48:52.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42242025-01-15T00:48:52.668ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42252025-01-15T00:48:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
42262025-01-15T00:48:52.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42272025-01-15T00:48:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42282025-01-15T00:48:52.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.634368ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
42292025-01-15T00:48:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42302025-01-15T00:48:52.671ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42312025-01-15T00:48:52.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42322025-01-15T00:48:52.672ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
42332025-01-15T00:48:52.672ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
42342025-01-15T00:48:52.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42352025-01-15T00:48:52.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42362025-01-15T00:48:52.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42372025-01-15T00:48:52.674ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42382025-01-15T00:48:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42392025-01-15T00:48:52.675ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42402025-01-15T00:48:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42412025-01-15T00:48:52.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42422025-01-15T00:48:52.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42432025-01-15T00:48:52.676ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42442025-01-15T00:48:52.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42452025-01-15T00:48:52.676ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42462025-01-15T00:48:52.676ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.461449ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42472025-01-15T00:48:52.676ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42482025-01-15T00:48:52.677ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42492025-01-15T00:48:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42502025-01-15T00:48:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42512025-01-15T00:48:52.679ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42522025-01-15T00:48:52.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42532025-01-15T00:48:52.679ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.048148ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42542025-01-15T00:48:52.682ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42552025-01-15T00:48:52.682ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42562025-01-15T00:48:52.682ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42572025-01-15T00:48:52.682ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42582025-01-15T00:48:52.682ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42592025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42602025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42612025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42622025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42632025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42642025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42652025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42662025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42672025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42682025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.081336ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
42692025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42702025-01-15T00:48:52.683ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
42712025-01-15T00:48:52.683ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.467422ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
42722025-01-15T00:48:52.685ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
42732025-01-15T00:48:52.685ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42742025-01-15T00:48:52.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42752025-01-15T00:48:52.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
42762025-01-15T00:48:52.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.750792ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
42772025-01-15T00:48:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42782025-01-15T00:48:52.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42792025-01-15T00:48:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42802025-01-15T00:48:52.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42812025-01-15T00:48:52.690ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42822025-01-15T00:48:52.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42832025-01-15T00:48:52.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42842025-01-15T00:48:52.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42852025-01-15T00:48:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42862025-01-15T00:48:52.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42872025-01-15T00:48:52.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42882025-01-15T00:48:52.706ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42892025-01-15T00:48:52.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42902025-01-15T00:48:52.708ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42912025-01-15T00:48:52.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
42922025-01-15T00:48:52.712ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42932025-01-15T00:48:52.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42942025-01-15T00:48:52.715ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.946866ms iteration = 9 status = 0
42952025-01-15T00:48:52.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 108.821015ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42962025-01-15T00:48:52.716ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42972025-01-15T00:48:52.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42982025-01-15T00:48:52.717ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42992025-01-15T00:48:52.717ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43002025-01-15T00:48:52.717ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43012025-01-15T00:48:52.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43022025-01-15T00:48:52.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43032025-01-15T00:48:52.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43042025-01-15T00:48:52.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43052025-01-15T00:48:52.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43062025-01-15T00:48:52.719ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
43072025-01-15T00:48:52.719ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43082025-01-15T00:48:52.719ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 114.33319ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43092025-01-15T00:48:52.720ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43102025-01-15T00:48:52.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43112025-01-15T00:48:52.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.154648ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43122025-01-15T00:48:52.720ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43132025-01-15T00:48:52.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43142025-01-15T00:48:52.721ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43152025-01-15T00:48:52.721ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43162025-01-15T00:48:52.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43172025-01-15T00:48:52.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43182025-01-15T00:48:52.722ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43192025-01-15T00:48:52.722ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43202025-01-15T00:48:52.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43212025-01-15T00:48:52.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43222025-01-15T00:48:52.724ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43232025-01-15T00:48:52.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43242025-01-15T00:48:52.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
43252025-01-15T00:48:52.725ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43262025-01-15T00:48:52.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43272025-01-15T00:48:52.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43282025-01-15T00:48:52.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43292025-01-15T00:48:52.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43302025-01-15T00:48:52.728ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43312025-01-15T00:48:52.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43322025-01-15T00:48:52.728ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
43332025-01-15T00:48:52.728ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43342025-01-15T00:48:52.729ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
43352025-01-15T00:48:52.729ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 125.798291ms iteration = 5 status = {"generation":1}
43362025-01-15T00:48:52.733ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 127.876901ms iteration = 11 status = {"physical_disks_added":0}
43372025-01-15T00:48:52.737ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
43382025-01-15T00:48:52.737ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 134.669962ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43392025-01-15T00:48:52.744ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43402025-01-15T00:48:52.752ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43412025-01-15T00:48:52.752ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43422025-01-15T00:48:52.752ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.230104ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43432025-01-15T00:48:52.754ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
43442025-01-15T00:48:52.754ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
43452025-01-15T00:48:52.754ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
43462025-01-15T00:48:52.754ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43472025-01-15T00:48:52.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43482025-01-15T00:48:52.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43492025-01-15T00:48:52.757ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
43502025-01-15T00:48:52.757ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43512025-01-15T00:48:52.758ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "500b55f2-9c78-4417-a8e6-e63bd8bdcc43", "content-length": "26", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
43522025-01-15T00:48:52.758ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43532025-01-15T00:48:52.758ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
43542025-01-15T00:48:52.758ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 153.577606ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
43552025-01-15T00:48:52.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43562025-01-15T00:48:52.759ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43572025-01-15T00:48:52.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43582025-01-15T00:48:52.760ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43592025-01-15T00:48:52.761ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
43602025-01-15T00:48:52.761ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
43612025-01-15T00:48:52.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43622025-01-15T00:48:52.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43632025-01-15T00:48:52.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642025-01-15T00:48:52.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.003754ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43652025-01-15T00:48:52.766ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
43662025-01-15T00:48:52.766ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43672025-01-15T00:48:52.766ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43682025-01-15T00:48:52.766ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43692025-01-15T00:48:52.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43702025-01-15T00:48:52.766ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bcf579c-9440-4c6c-a087-f0335b674980", "content-length": "26", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
43712025-01-15T00:48:52.766ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43722025-01-15T00:48:52.768ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
43732025-01-15T00:48:52.768ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43742025-01-15T00:48:52.768ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
43752025-01-15T00:48:52.768ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 165.629358ms iteration = 5 status = {"generation":2}
43762025-01-15T00:48:52.769ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43772025-01-15T00:48:52.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43782025-01-15T00:48:52.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43792025-01-15T00:48:52.805ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43802025-01-15T00:48:52.807ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43812025-01-15T00:48:52.807ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43822025-01-15T00:48:52.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43832025-01-15T00:48:52.809ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43842025-01-15T00:48:52.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43852025-01-15T00:48:52.810ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43862025-01-15T00:48:52.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43872025-01-15T00:48:52.828ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43882025-01-15T00:48:52.828ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 221.440182ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43892025-01-15T00:48:52.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43902025-01-15T00:48:52.907ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
43912025-01-15T00:48:52.907ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43922025-01-15T00:48:52.908ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dae27dd-bbb6-4f9b-90c3-8e4117e2114c", "content-length": "26", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
43932025-01-15T00:48:52.908ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43942025-01-15T00:48:52.911ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
43952025-01-15T00:48:52.914ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43962025-01-15T00:48:52.915ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "f60da0cd-14bc-4a37-aea5-3f324aa85d57", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43972025-01-15T00:48:52.915ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43982025-01-15T00:48:52.917ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "39bf8575-bbfd-4a52-8296-433f28631b30", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
43992025-01-15T00:48:52.917ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44002025-01-15T00:48:52.918ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
44012025-01-15T00:48:52.918ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 315.301088ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44022025-01-15T00:48:52.937ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
44032025-01-15T00:48:52.938ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "19af981c-f20f-49a2-95ea-a183389e05bd", "content-length": "1", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44042025-01-15T00:48:52.940ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44052025-01-15T00:48:52.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
44062025-01-15T00:48:52.942ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44072025-01-15T00:48:52.942ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44082025-01-15T00:48:52.942ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 339.370431ms iteration = 9 status = {}
44092025-01-15T00:48:52.942ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "99362030-2fb1-4e48-ac74-c6ad52782fa7", "content-length": "372", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44102025-01-15T00:48:52.942ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44112025-01-15T00:48:52.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44122025-01-15T00:48:52.949ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 345.852146ms iteration = 9 status = null
44132025-01-15T00:48:52.965ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
44142025-01-15T00:48:52.965ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44152025-01-15T00:48:52.982ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44162025-01-15T00:48:53.055ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "df8da1bd-8857-4d6a-8c73-ea7c44095366", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44172025-01-15T00:48:53.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44182025-01-15T00:48:53.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44192025-01-15T00:48:53.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44202025-01-15T00:48:53.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44212025-01-15T00:48:53.062ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44222025-01-15T00:48:53.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44232025-01-15T00:48:53.062ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d9293e99-02f5-4c35-8aa7-32cb16f680be", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44242025-01-15T00:48:53.062ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44252025-01-15T00:48:53.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44262025-01-15T00:48:53.064ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cd9e435e-d178-42cd-97c8-8cbf27d902e1", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44272025-01-15T00:48:53.064ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44282025-01-15T00:48:53.066ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7aa05573-9db1-493c-81e5-b994d9739e87", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44292025-01-15T00:48:53.066ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44302025-01-15T00:48:53.068ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44312025-01-15T00:48:53.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 465.339226ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44322025-01-15T00:48:53.085ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44332025-01-15T00:48:53.086ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd96ed37-f2ef-435b-bd35-a78a04a09610", "content-length": "691", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44342025-01-15T00:48:53.086ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
44352025-01-15T00:48:53.086ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
44362025-01-15T00:48:53.086ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
44372025-01-15T00:48:53.088ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 481.053298ms iteration = 9 status = {}
44382025-01-15T00:48:53.089ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44392025-01-15T00:48:53.089ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44402025-01-15T00:48:53.089ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "63281c9c-8e58-4fa8-bbb0-c3c0b6a6d807", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44412025-01-15T00:48:53.091ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 483.872662ms iteration = 9 status = {}
44422025-01-15T00:48:53.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44432025-01-15T00:48:53.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44442025-01-15T00:48:53.110ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
44452025-01-15T00:48:53.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44462025-01-15T00:48:53.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44472025-01-15T00:48:53.118ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44482025-01-15T00:48:53.118ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bfb86d0-f996-41df-9dbd-43eb85749a16", "content-length": "134", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44492025-01-15T00:48:53.118ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44502025-01-15T00:48:53.118ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
44512025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44522025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44532025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44542025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44552025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44562025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44572025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44582025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44592025-01-15T00:48:53.119ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
44602025-01-15T00:48:53.119ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44612025-01-15T00:48:53.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44622025-01-15T00:48:53.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44632025-01-15T00:48:53.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "61601716-46a0-4b0c-a397-78a2e4430f13", "content-length": "2", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44642025-01-15T00:48:53.121ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44652025-01-15T00:48:53.121ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7481666d-b326-4200-9b7e-448df777e3da", "content-length": "51", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44662025-01-15T00:48:53.121ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
44672025-01-15T00:48:53.121ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44682025-01-15T00:48:53.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "15ace1bf-7328-4365-80cb-ffcd2aca17f8", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44692025-01-15T00:48:53.214ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
44702025-01-15T00:48:53.214ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44712025-01-15T00:48:53.214ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7278bfdd-ec94-4ad1-bd2c-ab46dac97da7", "content-length": "682", "date": "Wed, 15 Jan 2025 00:48:52 GMT"} })
44722025-01-15T00:48:53.214ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44732025-01-15T00:48:53.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44742025-01-15T00:48:53.218ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44752025-01-15T00:48:53.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44762025-01-15T00:48:53.222ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44772025-01-15T00:48:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44782025-01-15T00:48:53.224ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44792025-01-15T00:48:53.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44802025-01-15T00:48:53.231ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 626.153901ms iteration = 9 status = {}
44812025-01-15T00:48:53.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = f540a86a-a47a-4804-8835-9930b415a090 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
44822025-01-15T00:48:53.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = f540a86a-a47a-4804-8835-9930b415a090 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
44832025-01-15T00:48:53.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2921 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = f540a86a-a47a-4804-8835-9930b415a090 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
44842025-01-15T00:48:53.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b48b10a3-f4eb-4023-a8e0-040edfb46007 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44852025-01-15T00:48:53.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b48b10a3-f4eb-4023-a8e0-040edfb46007 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44862025-01-15T00:48:53.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2540 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b48b10a3-f4eb-4023-a8e0-040edfb46007 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44872025-01-15T00:48:54.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = ed2038cc-01ed-47ea-a7ae-e9b5a12d5ddd response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
44882025-01-15T00:48:54.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 220979f7-2758-45eb-975e-88b0ef42d4f3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44892025-01-15T00:48:54.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 220979f7-2758-45eb-975e-88b0ef42d4f3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44902025-01-15T00:48:54.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 220979f7-2758-45eb-975e-88b0ef42d4f3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44912025-01-15T00:48:55.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 861b8632-2766-4b7c-ac09-d6c745e94009 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44922025-01-15T00:48:55.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 861b8632-2766-4b7c-ac09-d6c745e94009 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44932025-01-15T00:48:55.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 861b8632-2766-4b7c-ac09-d6c745e94009 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44942025-01-15T00:48:56.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c3c4afc-a72c-4d93-a744-906d843c2baa roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44952025-01-15T00:48:56.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c3c4afc-a72c-4d93-a744-906d843c2baa resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44962025-01-15T00:48:56.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c3c4afc-a72c-4d93-a744-906d843c2baa response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44972025-01-15T00:48:57.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b82c430-eb0b-4c37-a6d5-b0435a143b9d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44982025-01-15T00:48:57.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b82c430-eb0b-4c37-a6d5-b0435a143b9d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
44992025-01-15T00:48:57.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b82c430-eb0b-4c37-a6d5-b0435a143b9d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45002025-01-15T00:48:58.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d1e66ed8-7882-43b6-9699-05aefdefe935 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45012025-01-15T00:48:58.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d1e66ed8-7882-43b6-9699-05aefdefe935 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45022025-01-15T00:48:58.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2171 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d1e66ed8-7882-43b6-9699-05aefdefe935 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45032025-01-15T00:48:59.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 397cc034-7c29-40cf-9a1b-ca2e7b3d9477 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45042025-01-15T00:48:59.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 397cc034-7c29-40cf-9a1b-ca2e7b3d9477 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45052025-01-15T00:48:59.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1581 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 397cc034-7c29-40cf-9a1b-ca2e7b3d9477 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45062025-01-15T00:49:00.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 673e7bfa-e1c2-4104-9bd2-df99fc3548de roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45072025-01-15T00:49:00.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 673e7bfa-e1c2-4104-9bd2-df99fc3548de resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45082025-01-15T00:49:00.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 673e7bfa-e1c2-4104-9bd2-df99fc3548de response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45092025-01-15T00:49:01.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 78a18e31-fd7c-476d-a996-4154641a5f1b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45102025-01-15T00:49:01.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 78a18e31-fd7c-476d-a996-4154641a5f1b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45112025-01-15T00:49:01.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2414 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 78a18e31-fd7c-476d-a996-4154641a5f1b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45122025-01-15T00:49:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
45132025-01-15T00:49:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45142025-01-15T00:49:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45152025-01-15T00:49:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45162025-01-15T00:49:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
45172025-01-15T00:49:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45182025-01-15T00:49:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45192025-01-15T00:49:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45202025-01-15T00:49:02.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45212025-01-15T00:49:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45222025-01-15T00:49:02.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45232025-01-15T00:49:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45242025-01-15T00:49:02.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45252025-01-15T00:49:02.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45262025-01-15T00:49:02.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272025-01-15T00:49:02.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
45282025-01-15T00:49:02.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45292025-01-15T00:49:02.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45302025-01-15T00:49:02.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
45312025-01-15T00:49:02.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.965062ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
45322025-01-15T00:49:02.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.578817ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45332025-01-15T00:49:02.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a9a3c61a-987d-45fe-94f9-cf3f6007efcc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45342025-01-15T00:49:02.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a9a3c61a-987d-45fe-94f9-cf3f6007efcc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45352025-01-15T00:49:02.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a9a3c61a-987d-45fe-94f9-cf3f6007efcc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45362025-01-15T00:49:03.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6fb6c272-ad44-461d-a1a6-54bb5efe4e3d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45372025-01-15T00:49:03.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6fb6c272-ad44-461d-a1a6-54bb5efe4e3d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45382025-01-15T00:49:03.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1706 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6fb6c272-ad44-461d-a1a6-54bb5efe4e3d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45392025-01-15T00:49:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 538 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 94479b88-daaf-4ef2-85a2-df28216d368c response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
45402025-01-15T00:49:04.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d805074c-1d24-4e0c-8435-20452d255581 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45412025-01-15T00:49:04.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d805074c-1d24-4e0c-8435-20452d255581 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45422025-01-15T00:49:04.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d805074c-1d24-4e0c-8435-20452d255581 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45432025-01-15T00:49:05.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 214c3d2d-8a88-40df-aa94-81b050237485 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45442025-01-15T00:49:05.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 214c3d2d-8a88-40df-aa94-81b050237485 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45452025-01-15T00:49:05.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 214c3d2d-8a88-40df-aa94-81b050237485 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45462025-01-15T00:49:06.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3bbaeddd-fd18-406c-a423-624dace233ac roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45472025-01-15T00:49:06.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3bbaeddd-fd18-406c-a423-624dace233ac resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45482025-01-15T00:49:06.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3200 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3bbaeddd-fd18-406c-a423-624dace233ac response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45492025-01-15T00:49:07.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6f2bce4-4d24-4a12-b739-3bf661599f5d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45502025-01-15T00:49:07.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6f2bce4-4d24-4a12-b739-3bf661599f5d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45512025-01-15T00:49:07.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2883 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c6f2bce4-4d24-4a12-b739-3bf661599f5d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45522025-01-15T00:49:08.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de611b7b-9079-4aa1-bc84-8e2a46ddbdf3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45532025-01-15T00:49:08.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de611b7b-9079-4aa1-bc84-8e2a46ddbdf3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45542025-01-15T00:49:08.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1844 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de611b7b-9079-4aa1-bc84-8e2a46ddbdf3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45552025-01-15T00:49:09.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7f8a58b-5baf-4171-92f2-6bcafc4fe807 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45562025-01-15T00:49:09.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7f8a58b-5baf-4171-92f2-6bcafc4fe807 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45572025-01-15T00:49:09.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7f8a58b-5baf-4171-92f2-6bcafc4fe807 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45582025-01-15T00:49:10.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cc3315e-2b73-447e-9ad0-5993f8f2bf75 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45592025-01-15T00:49:10.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cc3315e-2b73-447e-9ad0-5993f8f2bf75 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45602025-01-15T00:49:10.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0cc3315e-2b73-447e-9ad0-5993f8f2bf75 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45612025-01-15T00:49:11.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 61d7ea02-54ab-4a66-8277-75964d0fe6d7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45622025-01-15T00:49:11.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 61d7ea02-54ab-4a66-8277-75964d0fe6d7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45632025-01-15T00:49:11.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2406 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 61d7ea02-54ab-4a66-8277-75964d0fe6d7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45642025-01-15T00:49:12.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
45652025-01-15T00:49:12.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45662025-01-15T00:49:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45672025-01-15T00:49:12.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45682025-01-15T00:49:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45692025-01-15T00:49:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45702025-01-15T00:49:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45712025-01-15T00:49:12.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
45722025-01-15T00:49:12.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45732025-01-15T00:49:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45742025-01-15T00:49:12.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45752025-01-15T00:49:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45762025-01-15T00:49:12.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45772025-01-15T00:49:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45782025-01-15T00:49:12.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45792025-01-15T00:49:12.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.259222ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45802025-01-15T00:49:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
45812025-01-15T00:49:12.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45822025-01-15T00:49:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45832025-01-15T00:49:12.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
45842025-01-15T00:49:12.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.598846ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
45852025-01-15T00:49:12.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 29993a6f-8dce-45e7-9c92-a29eb3565c82 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45862025-01-15T00:49:12.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 29993a6f-8dce-45e7-9c92-a29eb3565c82 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45872025-01-15T00:49:12.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1777 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 29993a6f-8dce-45e7-9c92-a29eb3565c82 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45882025-01-15T00:49:13.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a9810c09-90d8-4be6-9eb5-27974723b32b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45892025-01-15T00:49:13.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a9810c09-90d8-4be6-9eb5-27974723b32b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45902025-01-15T00:49:13.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2287 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a9810c09-90d8-4be6-9eb5-27974723b32b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45912025-01-15T00:49:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 90040eef-5146-44b7-974a-555b143bdbde response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
45922025-01-15T00:49:14.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00e4079d-fbc0-41cb-8cdb-a894a56b1c9c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45932025-01-15T00:49:14.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00e4079d-fbc0-41cb-8cdb-a894a56b1c9c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45942025-01-15T00:49:14.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00e4079d-fbc0-41cb-8cdb-a894a56b1c9c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45952025-01-15T00:49:15.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6f7d4ae2-b52e-4765-a6f1-1294d3c4f6b7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45962025-01-15T00:49:15.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6f7d4ae2-b52e-4765-a6f1-1294d3c4f6b7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45972025-01-15T00:49:15.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6f7d4ae2-b52e-4765-a6f1-1294d3c4f6b7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45982025-01-15T00:49:17.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 78bda396-7783-47e1-9d26-5654b4aa68c3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
45992025-01-15T00:49:17.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 78bda396-7783-47e1-9d26-5654b4aa68c3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46002025-01-15T00:49:17.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 78bda396-7783-47e1-9d26-5654b4aa68c3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46012025-01-15T00:49:18.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b87da44b-1d98-4cae-9a3e-363e4899db59 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46022025-01-15T00:49:18.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b87da44b-1d98-4cae-9a3e-363e4899db59 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46032025-01-15T00:49:18.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1897 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b87da44b-1d98-4cae-9a3e-363e4899db59 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46042025-01-15T00:49:19.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff314845-4f4d-4761-aaa3-2b34c361f57d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46052025-01-15T00:49:19.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff314845-4f4d-4761-aaa3-2b34c361f57d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46062025-01-15T00:49:19.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff314845-4f4d-4761-aaa3-2b34c361f57d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46072025-01-15T00:49:20.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 720fd51c-ce66-496a-85d4-d3c8c2e48e24 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46082025-01-15T00:49:20.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 720fd51c-ce66-496a-85d4-d3c8c2e48e24 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46092025-01-15T00:49:20.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2039 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 720fd51c-ce66-496a-85d4-d3c8c2e48e24 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46102025-01-15T00:49:21.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdffba0c-6338-41a1-8595-77b907433a66 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46112025-01-15T00:49:21.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdffba0c-6338-41a1-8595-77b907433a66 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46122025-01-15T00:49:21.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdffba0c-6338-41a1-8595-77b907433a66 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46132025-01-15T00:49:22.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7e0c4a3b-4b72-4464-960f-d8ec21d46811 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46142025-01-15T00:49:22.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7e0c4a3b-4b72-4464-960f-d8ec21d46811 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46152025-01-15T00:49:22.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7e0c4a3b-4b72-4464-960f-d8ec21d46811 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
46162025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
46172025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46182025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
46192025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
46202025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46212025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46222025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
46232025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46242025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46252025-01-15T00:49:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46262025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
46272025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
46282025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46292025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46302025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
46312025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
46322025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46332025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46342025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46352025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46362025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46372025-01-15T00:49:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46382025-01-15T00:49:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1182, tv_nsec: 935825101 } })
46392025-01-15T00:49:22.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46402025-01-15T00:49:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
46412025-01-15T00:49:22.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1182, tv_nsec: 936978943 } })
46422025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.099209ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46432025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46442025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
46452025-01-15T00:49:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46462025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46472025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
46482025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46492025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
46502025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46512025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46522025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
46532025-01-15T00:49:22.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
46542025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46552025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
46562025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46572025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
46582025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46592025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46602025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46612025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46622025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46632025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46642025-01-15T00:49:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46652025-01-15T00:49:22.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46662025-01-15T00:49:22.608ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46672025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
46682025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
46692025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46702025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46712025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
46722025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46732025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
46742025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46752025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46762025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46772025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46782025-01-15T00:49:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46792025-01-15T00:49:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46802025-01-15T00:49:22.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46812025-01-15T00:49:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46822025-01-15T00:49:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46832025-01-15T00:49:22.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46842025-01-15T00:49:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46852025-01-15T00:49:22.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46862025-01-15T00:49:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46872025-01-15T00:49:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46882025-01-15T00:49:22.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46892025-01-15T00:49:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46902025-01-15T00:49:22.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46912025-01-15T00:49:22.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46922025-01-15T00:49:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46932025-01-15T00:49:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46942025-01-15T00:49:22.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46952025-01-15T00:49:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46962025-01-15T00:49:22.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46972025-01-15T00:49:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46982025-01-15T00:49:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46992025-01-15T00:49:22.614ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47002025-01-15T00:49:22.614ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47012025-01-15T00:49:22.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47022025-01-15T00:49:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47032025-01-15T00:49:22.616ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47042025-01-15T00:49:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47052025-01-15T00:49:22.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47062025-01-15T00:49:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47072025-01-15T00:49:22.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47082025-01-15T00:49:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47092025-01-15T00:49:22.622ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47102025-01-15T00:49:22.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47112025-01-15T00:49:22.624ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1182, tv_nsec: 954292676 } })
47122025-01-15T00:49:22.624ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
47132025-01-15T00:49:22.644ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47142025-01-15T00:49:22.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47152025-01-15T00:49:22.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47162025-01-15T00:49:22.646ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47172025-01-15T00:49:22.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47182025-01-15T00:49:22.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47192025-01-15T00:49:22.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47202025-01-15T00:49:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47212025-01-15T00:49:22.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47222025-01-15T00:49:22.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47232025-01-15T00:49:22.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47242025-01-15T00:49:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47252025-01-15T00:49:22.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47262025-01-15T00:49:22.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47272025-01-15T00:49:22.663ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47282025-01-15T00:49:22.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47292025-01-15T00:49:22.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 56.550258ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
47302025-01-15T00:49:22.666ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.72669ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47312025-01-15T00:49:22.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 58.640209ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
47322025-01-15T00:49:22.670ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47332025-01-15T00:49:22.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47342025-01-15T00:49:22.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47352025-01-15T00:49:22.671ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47362025-01-15T00:49:22.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47372025-01-15T00:49:22.672ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47382025-01-15T00:49:22.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.313807ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47392025-01-15T00:49:22.672ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47402025-01-15T00:49:22.674ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47412025-01-15T00:49:22.674ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47422025-01-15T00:49:22.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47432025-01-15T00:49:22.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
47442025-01-15T00:49:22.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47452025-01-15T00:49:22.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47462025-01-15T00:49:22.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47472025-01-15T00:49:22.675ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47482025-01-15T00:49:22.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47492025-01-15T00:49:22.676ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47502025-01-15T00:49:22.676ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47512025-01-15T00:49:22.676ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47522025-01-15T00:49:22.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47532025-01-15T00:49:22.678ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47542025-01-15T00:49:22.678ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 71.052897ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47552025-01-15T00:49:22.685ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
47562025-01-15T00:49:22.685ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.756442ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
47572025-01-15T00:49:22.690ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47582025-01-15T00:49:22.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
47592025-01-15T00:49:22.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47602025-01-15T00:49:22.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47612025-01-15T00:49:22.693ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47622025-01-15T00:49:22.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47632025-01-15T00:49:22.695ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 90.218496ms iteration = 10 status = 0
47642025-01-15T00:49:22.699ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
47652025-01-15T00:49:22.699ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47662025-01-15T00:49:22.700ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71df1e82-caed-4088-aa57-bdaeda9bc829", "content-length": "26", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
47672025-01-15T00:49:22.700ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47682025-01-15T00:49:22.702ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47692025-01-15T00:49:22.703ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
47702025-01-15T00:49:22.703ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47712025-01-15T00:49:22.706ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.704861ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47722025-01-15T00:49:22.706ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "799ad566-11d3-48e3-ab97-25edeca39443", "content-length": "26", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
47732025-01-15T00:49:22.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47742025-01-15T00:49:22.708ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47752025-01-15T00:49:22.714ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47762025-01-15T00:49:22.714ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47772025-01-15T00:49:22.714ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.176802ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47782025-01-15T00:49:22.714ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
47792025-01-15T00:49:22.714ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 109.763412ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
47802025-01-15T00:49:22.734ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.273211ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47812025-01-15T00:49:22.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47822025-01-15T00:49:22.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47832025-01-15T00:49:22.768ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
47842025-01-15T00:49:22.768ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47852025-01-15T00:49:22.768ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a166b68f-2d91-433c-a7ad-3147fdde60d9", "content-length": "26", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
47862025-01-15T00:49:22.768ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47872025-01-15T00:49:22.770ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
47882025-01-15T00:49:22.779ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 174.58965ms iteration = 12 status = {"physical_disks_added":0}
47892025-01-15T00:49:22.824ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
47902025-01-15T00:49:22.824ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "154488e1-6cee-4228-bff7-43d4a1a68ad6", "content-length": "1", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
47912025-01-15T00:49:22.826ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47922025-01-15T00:49:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47932025-01-15T00:49:22.828ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 225.684504ms iteration = 10 status = null
47942025-01-15T00:49:22.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47952025-01-15T00:49:22.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47962025-01-15T00:49:22.838ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47972025-01-15T00:49:22.839ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 236.236796ms iteration = 10 status = {}
47982025-01-15T00:49:22.839ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47992025-01-15T00:49:22.839ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48002025-01-15T00:49:22.840ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4af91c0-755a-4f3c-b2e1-e4e50713bab5", "content-length": "372", "date": "Wed, 15 Jan 2025 00:49:21 GMT"} })
48012025-01-15T00:49:22.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48022025-01-15T00:49:22.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48032025-01-15T00:49:22.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48042025-01-15T00:49:22.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48052025-01-15T00:49:22.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48062025-01-15T00:49:22.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48072025-01-15T00:49:22.844ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48082025-01-15T00:49:22.844ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48092025-01-15T00:49:22.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48102025-01-15T00:49:22.855ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48112025-01-15T00:49:22.855ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48122025-01-15T00:49:22.856ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "186acfd7-ec79-466d-bfeb-78c12af611f6", "date": "Wed, 15 Jan 2025 00:49:21 GMT"} })
48132025-01-15T00:49:22.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48142025-01-15T00:49:22.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48152025-01-15T00:49:22.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48162025-01-15T00:49:22.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48172025-01-15T00:49:22.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48182025-01-15T00:49:22.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48192025-01-15T00:49:22.868ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48202025-01-15T00:49:22.868ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48212025-01-15T00:49:22.868ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cb17cfe7-0ab0-4dc9-94b5-ace06bdeb3ef", "date": "Wed, 15 Jan 2025 00:49:21 GMT"} })
48222025-01-15T00:49:22.869ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 262.40489ms iteration = 10 status = {}
48232025-01-15T00:49:22.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48242025-01-15T00:49:22.914ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5445f7df-cc13-4dad-84d0-9eaac428413b", "content-length": "691", "date": "Wed, 15 Jan 2025 00:49:21 GMT"} })
48252025-01-15T00:49:22.914ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
48262025-01-15T00:49:22.914ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
48272025-01-15T00:49:22.915ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
48282025-01-15T00:49:22.915ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 308.475227ms iteration = 10 status = {}
48292025-01-15T00:49:22.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48302025-01-15T00:49:22.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48312025-01-15T00:49:22.950ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
48322025-01-15T00:49:22.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48332025-01-15T00:49:22.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48342025-01-15T00:49:22.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48352025-01-15T00:49:22.963ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f7d4de1-bef4-4a71-b3e2-c5df80b5f01d", "content-length": "134", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
48362025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48372025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
48382025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48392025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48402025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48412025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48422025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48432025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48442025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48452025-01-15T00:49:22.963ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48462025-01-15T00:49:22.964ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
48472025-01-15T00:49:22.964ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48482025-01-15T00:49:22.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48492025-01-15T00:49:22.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48502025-01-15T00:49:22.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "055f4271-1a9e-467d-b6eb-1522909fd13c", "content-length": "2", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
48512025-01-15T00:49:22.967ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48522025-01-15T00:49:22.967ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d1dd372-dcfc-4744-b415-9b26133ef3fd", "content-length": "51", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
48532025-01-15T00:49:22.967ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
48542025-01-15T00:49:22.967ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48552025-01-15T00:49:23.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "11c470dc-889d-4741-beb9-dce061b7b792", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
48562025-01-15T00:49:23.059ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
48572025-01-15T00:49:23.059ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48582025-01-15T00:49:23.059ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d44a288-e135-46d5-962c-00a48934fcca", "content-length": "682", "date": "Wed, 15 Jan 2025 00:49:22 GMT"} })
48592025-01-15T00:49:23.059ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48602025-01-15T00:49:23.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48612025-01-15T00:49:23.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48622025-01-15T00:49:23.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48632025-01-15T00:49:23.065ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48642025-01-15T00:49:23.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48652025-01-15T00:49:23.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48662025-01-15T00:49:23.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48672025-01-15T00:49:23.075ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 469.965604ms iteration = 10 status = {}
48682025-01-15T00:49:23.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac2960c0-4d42-406f-8c5e-9a72a4c34f68 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48692025-01-15T00:49:23.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac2960c0-4d42-406f-8c5e-9a72a4c34f68 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48702025-01-15T00:49:23.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac2960c0-4d42-406f-8c5e-9a72a4c34f68 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48712025-01-15T00:49:23.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 57ec9492-5acd-42c2-9d7a-b05140ff7e27 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
48722025-01-15T00:49:23.325ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 57ec9492-5acd-42c2-9d7a-b05140ff7e27 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
48732025-01-15T00:49:23.327ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2675 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 57ec9492-5acd-42c2-9d7a-b05140ff7e27 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
48742025-01-15T00:49:24.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 63a8b434-fac7-4ba0-83f7-16c7393f0305 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48752025-01-15T00:49:24.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 63a8b434-fac7-4ba0-83f7-16c7393f0305 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48762025-01-15T00:49:24.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 63a8b434-fac7-4ba0-83f7-16c7393f0305 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48772025-01-15T00:49:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 594 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 3c186a49-6425-4c80-8a49-91b948965c29 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
48782025-01-15T00:49:25.204ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0f0c982-7ddc-42ed-b2f5-7cb681f2b859 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48792025-01-15T00:49:25.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0f0c982-7ddc-42ed-b2f5-7cb681f2b859 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48802025-01-15T00:49:25.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2679 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0f0c982-7ddc-42ed-b2f5-7cb681f2b859 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48812025-01-15T00:49:26.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5af3dfa5-2dda-4b35-b48f-fc7c5cf51b06 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48822025-01-15T00:49:26.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5af3dfa5-2dda-4b35-b48f-fc7c5cf51b06 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48832025-01-15T00:49:26.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1810 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5af3dfa5-2dda-4b35-b48f-fc7c5cf51b06 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48842025-01-15T00:49:27.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37fdf7b5-8b82-4c47-bd30-cff874840b47 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48852025-01-15T00:49:27.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37fdf7b5-8b82-4c47-bd30-cff874840b47 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48862025-01-15T00:49:27.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37fdf7b5-8b82-4c47-bd30-cff874840b47 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48872025-01-15T00:49:28.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d666442-fe4a-4534-bb42-6e28f9dbc4e9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48882025-01-15T00:49:28.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d666442-fe4a-4534-bb42-6e28f9dbc4e9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48892025-01-15T00:49:28.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d666442-fe4a-4534-bb42-6e28f9dbc4e9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48902025-01-15T00:49:29.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 620d40d4-b145-4ab5-aa2f-c1b2d876ae5e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48912025-01-15T00:49:29.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 620d40d4-b145-4ab5-aa2f-c1b2d876ae5e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48922025-01-15T00:49:29.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2178 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 620d40d4-b145-4ab5-aa2f-c1b2d876ae5e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48932025-01-15T00:49:30.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 61040ca2-8dd2-410a-a864-3602b8ed3d80 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48942025-01-15T00:49:30.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 61040ca2-8dd2-410a-a864-3602b8ed3d80 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48952025-01-15T00:49:30.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 61040ca2-8dd2-410a-a864-3602b8ed3d80 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48962025-01-15T00:49:31.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4d991803-df81-4f4f-9ac4-9df39c57d4a4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48972025-01-15T00:49:31.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4d991803-df81-4f4f-9ac4-9df39c57d4a4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48982025-01-15T00:49:31.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4d991803-df81-4f4f-9ac4-9df39c57d4a4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
48992025-01-15T00:49:32.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72165677-1f5e-4c2c-937e-4f28b54ba388 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49002025-01-15T00:49:32.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72165677-1f5e-4c2c-937e-4f28b54ba388 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49012025-01-15T00:49:32.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1889 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72165677-1f5e-4c2c-937e-4f28b54ba388 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49022025-01-15T00:49:32.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
49032025-01-15T00:49:32.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49042025-01-15T00:49:32.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49052025-01-15T00:49:32.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49062025-01-15T00:49:32.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49072025-01-15T00:49:32.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49082025-01-15T00:49:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49092025-01-15T00:49:32.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
49102025-01-15T00:49:32.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49112025-01-15T00:49:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49122025-01-15T00:49:32.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49132025-01-15T00:49:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49142025-01-15T00:49:32.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49152025-01-15T00:49:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49162025-01-15T00:49:32.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49172025-01-15T00:49:32.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.12788ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49182025-01-15T00:49:32.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
49192025-01-15T00:49:32.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49202025-01-15T00:49:32.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49212025-01-15T00:49:32.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
49222025-01-15T00:49:32.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.247158ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
49232025-01-15T00:49:33.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d53b3b8e-231e-4a8c-9d4c-97984e244287 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49242025-01-15T00:49:33.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d53b3b8e-231e-4a8c-9d4c-97984e244287 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49252025-01-15T00:49:33.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d53b3b8e-231e-4a8c-9d4c-97984e244287 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49262025-01-15T00:49:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 2cf9eb32-cf0e-4471-b3b8-4c229d0990b9 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
49272025-01-15T00:49:34.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 23201470-b7d8-49c5-a0de-fe978f54a63c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49282025-01-15T00:49:34.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 23201470-b7d8-49c5-a0de-fe978f54a63c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49292025-01-15T00:49:34.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 23201470-b7d8-49c5-a0de-fe978f54a63c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49302025-01-15T00:49:35.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 876cc756-1115-4de3-8293-c1da5bd2aca4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49312025-01-15T00:49:35.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 876cc756-1115-4de3-8293-c1da5bd2aca4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49322025-01-15T00:49:35.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 876cc756-1115-4de3-8293-c1da5bd2aca4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49332025-01-15T00:49:36.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49e2193b-215c-4b61-9c0b-5241c0683175 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49342025-01-15T00:49:36.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49e2193b-215c-4b61-9c0b-5241c0683175 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49352025-01-15T00:49:36.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49e2193b-215c-4b61-9c0b-5241c0683175 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49362025-01-15T00:49:37.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b1c23d7a-2714-4a1d-b5ae-ea0e339c010e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49372025-01-15T00:49:37.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b1c23d7a-2714-4a1d-b5ae-ea0e339c010e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49382025-01-15T00:49:37.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b1c23d7a-2714-4a1d-b5ae-ea0e339c010e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49392025-01-15T00:49:38.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 18a2cf5b-ad2b-4257-aad1-656af03bb71e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49402025-01-15T00:49:38.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 18a2cf5b-ad2b-4257-aad1-656af03bb71e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49412025-01-15T00:49:38.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 18a2cf5b-ad2b-4257-aad1-656af03bb71e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49422025-01-15T00:49:39.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a884dbc3-51e4-4ada-aa56-200a2046e120 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49432025-01-15T00:49:39.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a884dbc3-51e4-4ada-aa56-200a2046e120 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49442025-01-15T00:49:39.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a884dbc3-51e4-4ada-aa56-200a2046e120 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49452025-01-15T00:49:40.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f006383f-ee58-432f-a8a8-607c56414358 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49462025-01-15T00:49:40.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f006383f-ee58-432f-a8a8-607c56414358 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49472025-01-15T00:49:40.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1691 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f006383f-ee58-432f-a8a8-607c56414358 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49482025-01-15T00:49:41.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6908236c-7c22-4f32-8a20-84c39dda34a5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49492025-01-15T00:49:41.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6908236c-7c22-4f32-8a20-84c39dda34a5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49502025-01-15T00:49:41.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6908236c-7c22-4f32-8a20-84c39dda34a5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49512025-01-15T00:49:42.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 82a01d5a-8f4d-4136-890d-d61fe9604b1b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49522025-01-15T00:49:42.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 82a01d5a-8f4d-4136-890d-d61fe9604b1b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49532025-01-15T00:49:42.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 82a01d5a-8f4d-4136-890d-d61fe9604b1b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49542025-01-15T00:49:42.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
49552025-01-15T00:49:42.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49562025-01-15T00:49:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49572025-01-15T00:49:42.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49582025-01-15T00:49:42.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
49592025-01-15T00:49:42.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49602025-01-15T00:49:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49612025-01-15T00:49:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49622025-01-15T00:49:42.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49632025-01-15T00:49:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49642025-01-15T00:49:42.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49652025-01-15T00:49:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49662025-01-15T00:49:42.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49672025-01-15T00:49:42.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49682025-01-15T00:49:42.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.63253ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49692025-01-15T00:49:42.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49702025-01-15T00:49:42.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
49712025-01-15T00:49:42.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49722025-01-15T00:49:42.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49732025-01-15T00:49:42.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
49742025-01-15T00:49:42.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.990704ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
49752025-01-15T00:49:43.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 915cd3f8-e103-4782-8c5f-511b2d53cf3e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49762025-01-15T00:49:43.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 915cd3f8-e103-4782-8c5f-511b2d53cf3e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49772025-01-15T00:49:43.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2611 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 915cd3f8-e103-4782-8c5f-511b2d53cf3e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49782025-01-15T00:49:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 627 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 85f2d4b8-d410-45ab-aa1c-257bded5e736 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
49792025-01-15T00:49:44.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 710dc375-bd11-40e3-9413-1cc6ff4b97c5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49802025-01-15T00:49:44.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 710dc375-bd11-40e3-9413-1cc6ff4b97c5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49812025-01-15T00:49:44.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 710dc375-bd11-40e3-9413-1cc6ff4b97c5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49822025-01-15T00:49:45.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cae52f58-ba60-49c2-941d-beebe90473e9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49832025-01-15T00:49:45.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cae52f58-ba60-49c2-941d-beebe90473e9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49842025-01-15T00:49:45.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2479 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cae52f58-ba60-49c2-941d-beebe90473e9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49852025-01-15T00:49:46.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d2b5006-1fe5-41db-834b-a0539da81b42 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49862025-01-15T00:49:46.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d2b5006-1fe5-41db-834b-a0539da81b42 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49872025-01-15T00:49:46.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9d2b5006-1fe5-41db-834b-a0539da81b42 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49882025-01-15T00:49:47.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2ad2abae-5627-4945-b3a3-d7e6b4f3b5a3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49892025-01-15T00:49:47.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2ad2abae-5627-4945-b3a3-d7e6b4f3b5a3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49902025-01-15T00:49:47.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2ad2abae-5627-4945-b3a3-d7e6b4f3b5a3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49912025-01-15T00:49:48.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cff1b384-65b8-4c9c-a138-0cb5ca07f086 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49922025-01-15T00:49:48.699ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cff1b384-65b8-4c9c-a138-0cb5ca07f086 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49932025-01-15T00:49:48.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1956 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cff1b384-65b8-4c9c-a138-0cb5ca07f086 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49942025-01-15T00:49:49.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff1f8c9f-6404-4b68-bfa7-99bb841f8ec8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49952025-01-15T00:49:49.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff1f8c9f-6404-4b68-bfa7-99bb841f8ec8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49962025-01-15T00:49:49.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff1f8c9f-6404-4b68-bfa7-99bb841f8ec8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49972025-01-15T00:49:50.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d4a1eb42-5666-4a5f-833d-619a0c12e9a3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49982025-01-15T00:49:50.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d4a1eb42-5666-4a5f-833d-619a0c12e9a3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
49992025-01-15T00:49:50.743ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2037 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d4a1eb42-5666-4a5f-833d-619a0c12e9a3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
50002025-01-15T00:49:51.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5958c842-ec7d-4c33-bce2-809a147a3a45 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
50012025-01-15T00:49:51.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5958c842-ec7d-4c33-bce2-809a147a3a45 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
50022025-01-15T00:49:51.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2253 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5958c842-ec7d-4c33-bce2-809a147a3a45 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
50032025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
50042025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
50052025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50062025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
50072025-01-15T00:49:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
50082025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.98\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
50092025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
50102025-01-15T00:49:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:39:52.603121358 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50112025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
50122025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
50132025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50142025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50152025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50162025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50172025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
50182025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
50192025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50202025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
50212025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
50222025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
50232025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50242025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
50252025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
50262025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50272025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50282025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50292025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50302025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50312025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50322025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50332025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50342025-01-15T00:49:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1212, tv_nsec: 933552487 } })
50352025-01-15T00:49:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50362025-01-15T00:49:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1212, tv_nsec: 933546257 } })
50372025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
50382025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
50392025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.05211ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
50402025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.139242ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
50412025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
50422025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50432025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
50442025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
50452025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
50462025-01-15T00:49:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50472025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50482025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50492025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
50502025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50512025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50522025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50532025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50542025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50552025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50562025-01-15T00:49:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50572025-01-15T00:49:52.605ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50582025-01-15T00:49:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50592025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50602025-01-15T00:49:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1212, tv_nsec: 937120475 } })
50612025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
50622025-01-15T00:49:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50632025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
50642025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50652025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50662025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
50672025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50682025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
50692025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50702025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
50712025-01-15T00:49:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1212, tv_nsec: 937283149 } })
50722025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
50732025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50742025-01-15T00:49:52.607ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
50752025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
50762025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
50772025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50782025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
50792025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50802025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50812025-01-15T00:49:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
50822025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50832025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50842025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.586978ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50852025-01-15T00:49:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
50862025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50872025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50882025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50892025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50902025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50912025-01-15T00:49:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
50922025-01-15T00:49:52.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50932025-01-15T00:49:52.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50942025-01-15T00:49:52.608ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:39:52.603121358 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50952025-01-15T00:49:52.608ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.018677ms iteration = 6 status = {"expiration":"2025-01-15T00:39:52.603121358Z","pruned":[]}
50962025-01-15T00:49:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50972025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50982025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50992025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51002025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
51012025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51022025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
51032025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51042025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
51052025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51062025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
51072025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
51082025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
51092025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
51102025-01-15T00:49:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
51112025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51122025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51132025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51142025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51152025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51162025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51172025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51182025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51192025-01-15T00:49:52.610ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51202025-01-15T00:49:52.611ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51212025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51222025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51232025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51242025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51252025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51262025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51272025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51282025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51292025-01-15T00:49:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51302025-01-15T00:49:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51312025-01-15T00:49:52.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51322025-01-15T00:49:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51332025-01-15T00:49:52.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51342025-01-15T00:49:52.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51352025-01-15T00:49:52.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51362025-01-15T00:49:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51372025-01-15T00:49:52.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51382025-01-15T00:49:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51392025-01-15T00:49:52.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51402025-01-15T00:49:52.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51412025-01-15T00:49:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51422025-01-15T00:49:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51432025-01-15T00:49:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51442025-01-15T00:49:52.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51452025-01-15T00:49:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51462025-01-15T00:49:52.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51472025-01-15T00:49:52.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51482025-01-15T00:49:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51492025-01-15T00:49:52.625ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51502025-01-15T00:49:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51512025-01-15T00:49:52.625ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51522025-01-15T00:49:52.625ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51532025-01-15T00:49:52.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51542025-01-15T00:49:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51552025-01-15T00:49:52.625ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51562025-01-15T00:49:52.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51572025-01-15T00:49:52.627ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51582025-01-15T00:49:52.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51592025-01-15T00:49:52.628ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.058127ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
51602025-01-15T00:49:52.636ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51612025-01-15T00:49:52.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51622025-01-15T00:49:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51632025-01-15T00:49:52.636ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51642025-01-15T00:49:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51652025-01-15T00:49:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51662025-01-15T00:49:52.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51672025-01-15T00:49:52.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51682025-01-15T00:49:52.637ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1212, tv_nsec: 967466170 } })
51692025-01-15T00:49:52.637ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
51702025-01-15T00:49:52.639ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51712025-01-15T00:49:52.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51722025-01-15T00:49:52.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51732025-01-15T00:49:52.644ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51742025-01-15T00:49:52.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51752025-01-15T00:49:52.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51762025-01-15T00:49:52.653ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51772025-01-15T00:49:52.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
51782025-01-15T00:49:52.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51792025-01-15T00:49:52.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51802025-01-15T00:49:52.661ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
51812025-01-15T00:49:52.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
51822025-01-15T00:49:52.663ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51832025-01-15T00:49:52.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51842025-01-15T00:49:52.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51852025-01-15T00:49:52.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51862025-01-15T00:49:52.669ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 59.22181ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
51872025-01-15T00:49:52.669ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51882025-01-15T00:49:52.669ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
51892025-01-15T00:49:52.669ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
51902025-01-15T00:49:52.669ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
51912025-01-15T00:49:52.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51922025-01-15T00:49:52.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51932025-01-15T00:49:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51942025-01-15T00:49:52.672ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51952025-01-15T00:49:52.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51962025-01-15T00:49:52.673ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51972025-01-15T00:49:52.673ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51982025-01-15T00:49:52.673ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.614104ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51992025-01-15T00:49:52.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52002025-01-15T00:49:52.673ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52012025-01-15T00:49:52.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52022025-01-15T00:49:52.675ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52032025-01-15T00:49:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52042025-01-15T00:49:52.676ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52052025-01-15T00:49:52.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52062025-01-15T00:49:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52072025-01-15T00:49:52.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52082025-01-15T00:49:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52092025-01-15T00:49:52.677ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52102025-01-15T00:49:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52112025-01-15T00:49:52.678ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52122025-01-15T00:49:52.681ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52132025-01-15T00:49:52.681ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52142025-01-15T00:49:52.681ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52152025-01-15T00:49:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52162025-01-15T00:49:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52172025-01-15T00:49:52.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52182025-01-15T00:49:52.681ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52192025-01-15T00:49:52.682ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52202025-01-15T00:49:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52212025-01-15T00:49:52.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52222025-01-15T00:49:52.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52232025-01-15T00:49:52.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52242025-01-15T00:49:52.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.323597ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52252025-01-15T00:49:52.685ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52262025-01-15T00:49:52.685ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52272025-01-15T00:49:52.685ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52282025-01-15T00:49:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52292025-01-15T00:49:52.686ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52302025-01-15T00:49:52.686ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
52312025-01-15T00:49:52.686ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52322025-01-15T00:49:52.686ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
52332025-01-15T00:49:52.686ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
52342025-01-15T00:49:52.686ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.379796ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
52352025-01-15T00:49:52.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.434819ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52362025-01-15T00:49:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52372025-01-15T00:49:52.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52382025-01-15T00:49:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52392025-01-15T00:49:52.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52402025-01-15T00:49:52.688ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52412025-01-15T00:49:52.688ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52422025-01-15T00:49:52.688ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52432025-01-15T00:49:52.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52442025-01-15T00:49:52.688ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52452025-01-15T00:49:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52462025-01-15T00:49:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52472025-01-15T00:49:52.691ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52482025-01-15T00:49:52.691ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
52492025-01-15T00:49:52.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52502025-01-15T00:49:52.691ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
52512025-01-15T00:49:52.691ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 88.463723ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
52522025-01-15T00:49:52.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52532025-01-15T00:49:52.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52542025-01-15T00:49:52.691ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 87.374422ms iteration = 13 status = {"physical_disks_added":0}
52552025-01-15T00:49:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
52562025-01-15T00:49:52.692ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
52572025-01-15T00:49:52.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
52582025-01-15T00:49:52.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.505218ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
52592025-01-15T00:49:52.694ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52602025-01-15T00:49:52.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52612025-01-15T00:49:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52622025-01-15T00:49:52.698ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52632025-01-15T00:49:52.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52642025-01-15T00:49:52.699ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52652025-01-15T00:49:52.699ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52662025-01-15T00:49:52.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52672025-01-15T00:49:52.711ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52682025-01-15T00:49:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52692025-01-15T00:49:52.717ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52702025-01-15T00:49:52.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52712025-01-15T00:49:52.720ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52722025-01-15T00:49:52.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52732025-01-15T00:49:52.725ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
52742025-01-15T00:49:52.725ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 121.892576ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
52752025-01-15T00:49:52.729ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52762025-01-15T00:49:52.729ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52772025-01-15T00:49:52.729ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.11627ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52782025-01-15T00:49:52.730ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52792025-01-15T00:49:52.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52802025-01-15T00:49:52.733ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52812025-01-15T00:49:52.733ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 126.449043ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52822025-01-15T00:49:52.766ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
52832025-01-15T00:49:52.766ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52842025-01-15T00:49:52.766ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8042dd55-b566-4d21-9daa-6f2fa9046f17", "content-length": "26", "date": "Wed, 15 Jan 2025 00:49:51 GMT"} })
52852025-01-15T00:49:52.766ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52862025-01-15T00:49:52.767ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
52872025-01-15T00:49:52.768ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52882025-01-15T00:49:52.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52892025-01-15T00:49:52.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52902025-01-15T00:49:52.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1c03f085-9dea-4dc1-82a2-7d8edcd9f638 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
52912025-01-15T00:49:52.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1c03f085-9dea-4dc1-82a2-7d8edcd9f638 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
52922025-01-15T00:49:52.824ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
52932025-01-15T00:49:52.824ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52942025-01-15T00:49:52.824ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "19da723b-bad9-4bda-83af-4a29648930ce", "content-length": "26", "date": "Wed, 15 Jan 2025 00:49:51 GMT"} })
52952025-01-15T00:49:52.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52962025-01-15T00:49:52.826ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
52972025-01-15T00:49:52.876ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52982025-01-15T00:49:52.876ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52992025-01-15T00:49:52.876ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "856eb967-d655-41e1-b2d9-1a2dffb3dba5", "content-length": "372", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
53002025-01-15T00:49:52.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53012025-01-15T00:49:52.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53022025-01-15T00:49:52.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 267.746313ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
53032025-01-15T00:49:52.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53042025-01-15T00:49:52.878ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 274.299699ms iteration = 11 status = 0
53052025-01-15T00:49:52.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53062025-01-15T00:49:52.879ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
53072025-01-15T00:49:52.879ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53082025-01-15T00:49:52.879ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
53092025-01-15T00:49:52.879ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 276.759037ms iteration = 6 status = {"generation":2}
53102025-01-15T00:49:52.880ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
53112025-01-15T00:49:52.880ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
53122025-01-15T00:49:52.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53132025-01-15T00:49:52.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53142025-01-15T00:49:52.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1c03f085-9dea-4dc1-82a2-7d8edcd9f638 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
53152025-01-15T00:49:52.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53162025-01-15T00:49:52.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53172025-01-15T00:49:52.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53182025-01-15T00:49:52.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53192025-01-15T00:49:52.889ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
53202025-01-15T00:49:52.889ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
53212025-01-15T00:49:52.889ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
53222025-01-15T00:49:52.889ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 285.816841ms iteration = 6 status = {"generation":1}
53232025-01-15T00:49:52.901ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53242025-01-15T00:49:52.910ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 300.683347ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
53252025-01-15T00:49:52.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262025-01-15T00:49:52.920ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53272025-01-15T00:49:52.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53282025-01-15T00:49:52.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53292025-01-15T00:49:52.922ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53302025-01-15T00:49:52.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53312025-01-15T00:49:52.924ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53322025-01-15T00:49:52.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53332025-01-15T00:49:52.925ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53342025-01-15T00:49:52.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53352025-01-15T00:49:52.927ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
53362025-01-15T00:49:52.927ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 323.238011ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
53372025-01-15T00:49:52.936ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
53382025-01-15T00:49:52.936ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53392025-01-15T00:49:52.936ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "633879fb-79d8-4a88-95cf-736c3dace5d4", "content-length": "26", "date": "Wed, 15 Jan 2025 00:49:51 GMT"} })
53402025-01-15T00:49:52.936ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53412025-01-15T00:49:52.938ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53422025-01-15T00:49:52.945ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
53432025-01-15T00:49:52.945ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53442025-01-15T00:49:52.945ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4c4e8f4b-e7f1-487c-b4f7-3d15781a3e55", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
53452025-01-15T00:49:52.945ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53462025-01-15T00:49:52.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53472025-01-15T00:49:52.946ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53482025-01-15T00:49:52.947ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ab417ab-4212-4a25-9b0b-eb0887a2c1fc", "content-length": "1", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
53492025-01-15T00:49:52.948ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53502025-01-15T00:49:52.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53512025-01-15T00:49:52.949ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53522025-01-15T00:49:52.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53532025-01-15T00:49:52.951ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53542025-01-15T00:49:52.951ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 348.070029ms iteration = 11 status = null
53552025-01-15T00:49:52.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53562025-01-15T00:49:52.955ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53572025-01-15T00:49:52.955ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53582025-01-15T00:49:52.955ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "22dccdf2-bd58-42b7-9d08-010e8ae3889c", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
53592025-01-15T00:49:52.957ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 350.009566ms iteration = 11 status = {}
53602025-01-15T00:49:52.961ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53612025-01-15T00:49:52.961ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 353.549684ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53622025-01-15T00:49:52.965ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53632025-01-15T00:49:52.968ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
53642025-01-15T00:49:52.968ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53652025-01-15T00:49:52.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53662025-01-15T00:49:52.972ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53672025-01-15T00:49:52.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53682025-01-15T00:49:52.974ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53692025-01-15T00:49:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53702025-01-15T00:49:52.976ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53712025-01-15T00:49:52.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53722025-01-15T00:49:52.977ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53732025-01-15T00:49:52.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53742025-01-15T00:49:52.979ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53752025-01-15T00:49:52.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53762025-01-15T00:49:52.980ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53772025-01-15T00:49:52.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53782025-01-15T00:49:52.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53792025-01-15T00:49:52.985ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
53802025-01-15T00:49:52.985ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53812025-01-15T00:49:52.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53822025-01-15T00:49:52.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
53832025-01-15T00:49:52.988ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
53842025-01-15T00:49:53.015ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53852025-01-15T00:49:53.089ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.180787ms iteration = 11 status = {}
53862025-01-15T00:49:53.110ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53872025-01-15T00:49:53.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "236cacde-b6e0-4c6d-8fbb-e87a26dbe518", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53882025-01-15T00:49:53.110ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53892025-01-15T00:49:53.112ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2d0c6603-b9e2-479e-b957-15d6e02caffe", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53902025-01-15T00:49:53.112ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53912025-01-15T00:49:53.113ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53922025-01-15T00:49:53.113ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 510.79656ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53932025-01-15T00:49:53.159ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53942025-01-15T00:49:53.159ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "12e23079-a217-4f80-a551-403b8da16b06", "content-length": "691", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
53952025-01-15T00:49:53.159ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
53962025-01-15T00:49:53.159ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
53972025-01-15T00:49:53.159ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
53982025-01-15T00:49:53.160ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 552.618515ms iteration = 11 status = {}
53992025-01-15T00:49:53.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54002025-01-15T00:49:53.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54012025-01-15T00:49:53.163ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54022025-01-15T00:49:53.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54032025-01-15T00:49:53.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54042025-01-15T00:49:53.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54052025-01-15T00:49:53.168ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54062025-01-15T00:49:53.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54072025-01-15T00:49:53.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54082025-01-15T00:49:53.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54092025-01-15T00:49:53.198ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54102025-01-15T00:49:53.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
54112025-01-15T00:49:53.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54122025-01-15T00:49:53.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54132025-01-15T00:49:53.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54142025-01-15T00:49:53.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54152025-01-15T00:49:53.204ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54162025-01-15T00:49:53.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54172025-01-15T00:49:53.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54182025-01-15T00:49:53.208ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54192025-01-15T00:49:53.208ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba6cc2bb-44b1-4f48-aee2-07909d4815b4", "date": "Wed, 15 Jan 2025 00:49:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54202025-01-15T00:49:53.208ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54212025-01-15T00:49:53.209ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
54222025-01-15T00:49:53.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54232025-01-15T00:49:53.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54242025-01-15T00:49:53.210ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "afbfc19c-9a47-43e5-a33e-f7ba06edab92", "date": "Wed, 15 Jan 2025 00:49:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54252025-01-15T00:49:53.210ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54262025-01-15T00:49:53.212ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6d00dfe3-d51e-4e46-b74f-763c5bfd337e", "date": "Wed, 15 Jan 2025 00:49:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54272025-01-15T00:49:53.212ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54282025-01-15T00:49:53.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54292025-01-15T00:49:53.214ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
54302025-01-15T00:49:53.214ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 610.900946ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
54312025-01-15T00:49:53.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54322025-01-15T00:49:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54332025-01-15T00:49:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54342025-01-15T00:49:53.217ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54352025-01-15T00:49:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54362025-01-15T00:49:53.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54372025-01-15T00:49:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54382025-01-15T00:49:53.222ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54392025-01-15T00:49:53.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54402025-01-15T00:49:53.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54412025-01-15T00:49:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54422025-01-15T00:49:53.225ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54432025-01-15T00:49:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54442025-01-15T00:49:53.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54452025-01-15T00:49:53.229ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
54462025-01-15T00:49:53.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54472025-01-15T00:49:53.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54482025-01-15T00:49:53.231ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54492025-01-15T00:49:53.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54502025-01-15T00:49:53.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54512025-01-15T00:49:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54522025-01-15T00:49:53.233ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54532025-01-15T00:49:53.237ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
54542025-01-15T00:49:53.237ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54552025-01-15T00:49:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54562025-01-15T00:49:53.244ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
54572025-01-15T00:49:53.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54582025-01-15T00:49:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54592025-01-15T00:49:53.245ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54602025-01-15T00:49:53.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
54612025-01-15T00:49:53.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54622025-01-15T00:49:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54632025-01-15T00:49:53.248ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
54642025-01-15T00:49:53.248ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
54652025-01-15T00:49:53.248ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
54662025-01-15T00:49:53.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54672025-01-15T00:49:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54682025-01-15T00:49:53.251ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
54692025-01-15T00:49:53.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54702025-01-15T00:49:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54712025-01-15T00:49:53.259ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
54722025-01-15T00:49:53.259ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f4a5436-467f-43b0-a81f-4e60d288fc1f", "content-length": "134", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
54732025-01-15T00:49:53.259ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
54742025-01-15T00:49:53.259ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
54752025-01-15T00:49:53.259ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
54762025-01-15T00:49:53.259ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
54772025-01-15T00:49:53.259ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54782025-01-15T00:49:53.259ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54792025-01-15T00:49:53.259ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54802025-01-15T00:49:53.259ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54812025-01-15T00:49:53.260ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
54822025-01-15T00:49:53.260ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
54832025-01-15T00:49:53.260ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
54842025-01-15T00:49:53.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54852025-01-15T00:49:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54862025-01-15T00:49:53.262ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
54872025-01-15T00:49:53.262ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddf5b38c-51df-46c5-9d20-0bc49a1c4339", "content-length": "2", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
54882025-01-15T00:49:53.262ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
54892025-01-15T00:49:53.262ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ced6a08-8b03-4064-9802-8011ce7612e5", "content-length": "51", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
54902025-01-15T00:49:53.262ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
54912025-01-15T00:49:53.262ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54922025-01-15T00:49:53.356ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, time_created: 2025-01-15T00:45:37.185922Z, time_modified: 2025-01-15T00:45:37.185922Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
54932025-01-15T00:49:53.356ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
54942025-01-15T00:49:53.356ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54952025-01-15T00:49:53.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
54962025-01-15T00:49:53.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 74d26039-8c72-4a72-b829-e9b22059f826 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
54972025-01-15T00:49:53.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 74d26039-8c72-4a72-b829-e9b22059f826 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
54982025-01-15T00:49:53.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
54992025-01-15T00:49:53.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
55002025-01-15T00:49:53.360ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55012025-01-15T00:49:53.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 74d26039-8c72-4a72-b829-e9b22059f826 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
55022025-01-15T00:49:53.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
55032025-01-15T00:49:53.372ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "afa30156-1600-4299-b378-f5303f8280a8", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
55042025-01-15T00:49:53.372ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
55052025-01-15T00:49:53.372ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55062025-01-15T00:49:53.372ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "98e0e7b3-103b-4060-af75-10c8718dba9a", "content-length": "682", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
55072025-01-15T00:49:53.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55082025-01-15T00:49:53.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55092025-01-15T00:49:53.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55102025-01-15T00:49:53.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55112025-01-15T00:49:53.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55122025-01-15T00:49:53.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55132025-01-15T00:49:53.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55142025-01-15T00:49:53.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55152025-01-15T00:49:53.387ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 782.708514ms iteration = 11 status = {}
55162025-01-15T00:49:53.394ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
55172025-01-15T00:49:53.395ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "8138d199-2f4c-4f88-8675-b478232f5003", "date": "Wed, 15 Jan 2025 00:49:52 GMT"} })
55182025-01-15T00:49:53.396ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
55192025-01-15T00:49:53.396ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 788.846752ms
55202025-01-15T00:49:53.396ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 788.853942ms iteration = 2 status = {}
55212025-01-15T00:49:53.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0307b79c-94d9-4af1-8a07-f850f708acf8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55222025-01-15T00:49:53.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0307b79c-94d9-4af1-8a07-f850f708acf8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55232025-01-15T00:49:53.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2041 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0307b79c-94d9-4af1-8a07-f850f708acf8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55242025-01-15T00:49:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 531 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = b29f6191-b26c-4ba5-92df-a36e5c3adb70 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
55252025-01-15T00:49:54.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9321a75-b086-4955-ae2a-460239b40bc7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55262025-01-15T00:49:54.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9321a75-b086-4955-ae2a-460239b40bc7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55272025-01-15T00:49:54.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9321a75-b086-4955-ae2a-460239b40bc7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55282025-01-15T00:49:55.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dcbfbeff-85ff-44c2-8225-90ea7c824d4c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55292025-01-15T00:49:55.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dcbfbeff-85ff-44c2-8225-90ea7c824d4c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55302025-01-15T00:49:55.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2898 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dcbfbeff-85ff-44c2-8225-90ea7c824d4c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55312025-01-15T00:49:56.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 53d70138-9fdc-44ff-b89e-8cd4cc179a57 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55322025-01-15T00:49:56.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 53d70138-9fdc-44ff-b89e-8cd4cc179a57 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55332025-01-15T00:49:56.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 53d70138-9fdc-44ff-b89e-8cd4cc179a57 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55342025-01-15T00:49:57.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f387ebf7-f847-4820-8748-8194cc683dd1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55352025-01-15T00:49:57.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f387ebf7-f847-4820-8748-8194cc683dd1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55362025-01-15T00:49:57.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f387ebf7-f847-4820-8748-8194cc683dd1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55372025-01-15T00:49:59.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2781ec68-f3ac-4206-9e93-bfb4ae3657e9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55382025-01-15T00:49:59.012ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2781ec68-f3ac-4206-9e93-bfb4ae3657e9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55392025-01-15T00:49:59.014ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2115 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2781ec68-f3ac-4206-9e93-bfb4ae3657e9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55402025-01-15T00:50:00.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0a976055-3719-4a8d-9632-7daee509e541 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55412025-01-15T00:50:00.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0a976055-3719-4a8d-9632-7daee509e541 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55422025-01-15T00:50:00.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2953 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0a976055-3719-4a8d-9632-7daee509e541 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55432025-01-15T00:50:01.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a97533ad-3ab4-43b1-b0f2-77f453672988 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55442025-01-15T00:50:01.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a97533ad-3ab4-43b1-b0f2-77f453672988 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55452025-01-15T00:50:01.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a97533ad-3ab4-43b1-b0f2-77f453672988 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55462025-01-15T00:50:02.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 892111c3-b0b6-4637-b0a9-c79ec51a1c5f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55472025-01-15T00:50:02.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 892111c3-b0b6-4637-b0a9-c79ec51a1c5f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55482025-01-15T00:50:02.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 892111c3-b0b6-4637-b0a9-c79ec51a1c5f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55492025-01-15T00:50:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
55502025-01-15T00:50:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55512025-01-15T00:50:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55522025-01-15T00:50:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55532025-01-15T00:50:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55542025-01-15T00:50:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55552025-01-15T00:50:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55562025-01-15T00:50:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
55572025-01-15T00:50:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55582025-01-15T00:50:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55592025-01-15T00:50:02.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55602025-01-15T00:50:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55612025-01-15T00:50:02.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55622025-01-15T00:50:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
55632025-01-15T00:50:02.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55642025-01-15T00:50:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55652025-01-15T00:50:02.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
55662025-01-15T00:50:02.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.332778ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
55672025-01-15T00:50:02.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55682025-01-15T00:50:02.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55692025-01-15T00:50:02.670ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.671657ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55702025-01-15T00:50:03.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7295c3f4-6ff7-49a1-b3e4-bfbc80090aab roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55712025-01-15T00:50:03.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7295c3f4-6ff7-49a1-b3e4-bfbc80090aab resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55722025-01-15T00:50:03.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7295c3f4-6ff7-49a1-b3e4-bfbc80090aab response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55732025-01-15T00:50:04.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2fb5269a-2327-46f0-8af7-fe5c4ab05449 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55742025-01-15T00:50:04.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2fb5269a-2327-46f0-8af7-fe5c4ab05449 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55752025-01-15T00:50:04.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2fb5269a-2327-46f0-8af7-fe5c4ab05449 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55762025-01-15T00:50:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = e3de7eec-c7d2-40bd-8c26-c85b4b0b2a1d response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
55772025-01-15T00:50:05.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37391afc-94d3-4338-93b6-63c1d65e82c0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55782025-01-15T00:50:05.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37391afc-94d3-4338-93b6-63c1d65e82c0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55792025-01-15T00:50:05.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37391afc-94d3-4338-93b6-63c1d65e82c0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55802025-01-15T00:50:06.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0a1d587-fa5d-47f0-ae86-e0ed9b68bfe2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55812025-01-15T00:50:06.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0a1d587-fa5d-47f0-ae86-e0ed9b68bfe2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55822025-01-15T00:50:06.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2080 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d0a1d587-fa5d-47f0-ae86-e0ed9b68bfe2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55832025-01-15T00:50:07.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a6523f27-307c-4096-9dec-9c478ebbb413 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55842025-01-15T00:50:07.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a6523f27-307c-4096-9dec-9c478ebbb413 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55852025-01-15T00:50:07.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a6523f27-307c-4096-9dec-9c478ebbb413 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55862025-01-15T00:50:08.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e1f95c1-68a8-4113-9353-d6a1d40a4a3b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55872025-01-15T00:50:08.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e1f95c1-68a8-4113-9353-d6a1d40a4a3b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55882025-01-15T00:50:08.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e1f95c1-68a8-4113-9353-d6a1d40a4a3b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55892025-01-15T00:50:09.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = da2ebfaf-7ffb-4a86-bc36-68b8ddee8715 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55902025-01-15T00:50:09.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = da2ebfaf-7ffb-4a86-bc36-68b8ddee8715 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55912025-01-15T00:50:09.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1908 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = da2ebfaf-7ffb-4a86-bc36-68b8ddee8715 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55922025-01-15T00:50:10.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6943b081-b855-4621-b6b6-0a57027fb71e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55932025-01-15T00:50:10.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6943b081-b855-4621-b6b6-0a57027fb71e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55942025-01-15T00:50:10.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6943b081-b855-4621-b6b6-0a57027fb71e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55952025-01-15T00:50:11.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1e80913a-eb69-4d4d-ada4-6c8fa3c6006f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55962025-01-15T00:50:11.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1e80913a-eb69-4d4d-ada4-6c8fa3c6006f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55972025-01-15T00:50:11.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2545 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1e80913a-eb69-4d4d-ada4-6c8fa3c6006f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55982025-01-15T00:50:12.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4ada66da-7d16-459c-ac80-e4684fc64ae3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
55992025-01-15T00:50:12.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4ada66da-7d16-459c-ac80-e4684fc64ae3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56002025-01-15T00:50:12.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2472 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4ada66da-7d16-459c-ac80-e4684fc64ae3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56012025-01-15T00:50:12.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
56022025-01-15T00:50:12.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56032025-01-15T00:50:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56042025-01-15T00:50:12.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56052025-01-15T00:50:12.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
56062025-01-15T00:50:12.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56072025-01-15T00:50:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56082025-01-15T00:50:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56092025-01-15T00:50:12.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56102025-01-15T00:50:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56112025-01-15T00:50:12.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56122025-01-15T00:50:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56132025-01-15T00:50:12.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56142025-01-15T00:50:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56152025-01-15T00:50:12.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.612639ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56162025-01-15T00:50:12.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56172025-01-15T00:50:12.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
56182025-01-15T00:50:12.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56192025-01-15T00:50:12.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56202025-01-15T00:50:12.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
56212025-01-15T00:50:12.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.144174ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
56222025-01-15T00:50:13.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7ae18dc4-a5d6-4712-ab96-a7f59db04bde roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56232025-01-15T00:50:13.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7ae18dc4-a5d6-4712-ab96-a7f59db04bde resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56242025-01-15T00:50:13.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7ae18dc4-a5d6-4712-ab96-a7f59db04bde response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56252025-01-15T00:50:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 519 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = e21216e6-616d-486d-be8f-aae4c21892b8 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
56262025-01-15T00:50:14.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f3072ac-cb52-430e-95b0-4af6ee23e03e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56272025-01-15T00:50:14.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f3072ac-cb52-430e-95b0-4af6ee23e03e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56282025-01-15T00:50:14.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2495 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f3072ac-cb52-430e-95b0-4af6ee23e03e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56292025-01-15T00:50:15.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 15d7956c-516d-4297-8dfd-ee4a5019a5d3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56302025-01-15T00:50:15.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 15d7956c-516d-4297-8dfd-ee4a5019a5d3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56312025-01-15T00:50:15.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1984 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 15d7956c-516d-4297-8dfd-ee4a5019a5d3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56322025-01-15T00:50:16.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8a76a1a-1832-4f9a-b4c8-2a7f767eb7bc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56332025-01-15T00:50:16.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8a76a1a-1832-4f9a-b4c8-2a7f767eb7bc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56342025-01-15T00:50:16.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2749 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8a76a1a-1832-4f9a-b4c8-2a7f767eb7bc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56352025-01-15T00:50:17.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f03f055d-9d29-4efb-b9cc-3bbbf74adc59 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56362025-01-15T00:50:17.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f03f055d-9d29-4efb-b9cc-3bbbf74adc59 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56372025-01-15T00:50:17.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f03f055d-9d29-4efb-b9cc-3bbbf74adc59 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56382025-01-15T00:50:18.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7522b163-3273-4894-bde1-3b4129a74e88 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56392025-01-15T00:50:18.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7522b163-3273-4894-bde1-3b4129a74e88 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56402025-01-15T00:50:18.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7522b163-3273-4894-bde1-3b4129a74e88 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56412025-01-15T00:50:19.283ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::d]:57675
56422025-01-15T00:50:19.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c69980c4-6736-42fd-b07c-dc374eb9f061 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
56432025-01-15T00:50:19.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c69980c4-6736-42fd-b07c-dc374eb9f061 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
56442025-01-15T00:50:19.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c69980c4-6736-42fd-b07c-dc374eb9f061 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
56452025-01-15T00:50:19.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = f1cee4b8-cf96-49e5-bcfc-19ee341d1504 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
56462025-01-15T00:50:19.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = f1cee4b8-cf96-49e5-bcfc-19ee341d1504 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
56472025-01-15T00:50:19.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = f1cee4b8-cf96-49e5-bcfc-19ee341d1504 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
56482025-01-15T00:50:19.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca029831-1b8e-49c7-99db-40b61fad2276 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56492025-01-15T00:50:19.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca029831-1b8e-49c7-99db-40b61fad2276 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56502025-01-15T00:50:19.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2091 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca029831-1b8e-49c7-99db-40b61fad2276 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56512025-01-15T00:50:20.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e5910e7-bd36-402d-a61e-a5a6295c5848 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56522025-01-15T00:50:20.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e5910e7-bd36-402d-a61e-a5a6295c5848 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56532025-01-15T00:50:20.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1642 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e5910e7-bd36-402d-a61e-a5a6295c5848 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56542025-01-15T00:50:21.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f0e215e1-c7f0-4018-aa6a-58fb429e2384 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56552025-01-15T00:50:21.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f0e215e1-c7f0-4018-aa6a-58fb429e2384 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56562025-01-15T00:50:21.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f0e215e1-c7f0-4018-aa6a-58fb429e2384 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56572025-01-15T00:50:22.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9c9b4651-6b68-4944-a70a-99e74e91a66f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56582025-01-15T00:50:22.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9c9b4651-6b68-4944-a70a-99e74e91a66f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56592025-01-15T00:50:22.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9c9b4651-6b68-4944-a70a-99e74e91a66f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
56602025-01-15T00:50:22.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
56612025-01-15T00:50:22.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
56622025-01-15T00:50:22.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56632025-01-15T00:50:22.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
56642025-01-15T00:50:22.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56652025-01-15T00:50:22.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
56662025-01-15T00:50:22.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56672025-01-15T00:50:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56682025-01-15T00:50:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56692025-01-15T00:50:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56702025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
56712025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
56722025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56732025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
56742025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56752025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
56762025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56772025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56782025-01-15T00:50:22.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56792025-01-15T00:50:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56802025-01-15T00:50:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56812025-01-15T00:50:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56822025-01-15T00:50:22.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56832025-01-15T00:50:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1242, tv_nsec: 935706668 } })
56842025-01-15T00:50:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
56852025-01-15T00:50:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1242, tv_nsec: 936276659 } })
56862025-01-15T00:50:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
56872025-01-15T00:50:22.606ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56882025-01-15T00:50:22.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.320123ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56892025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
56902025-01-15T00:50:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56912025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56922025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56932025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
56942025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56952025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
56962025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56972025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
56982025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
56992025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57002025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57012025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57022025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
57032025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57042025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57052025-01-15T00:50:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57062025-01-15T00:50:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57072025-01-15T00:50:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57082025-01-15T00:50:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57092025-01-15T00:50:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57102025-01-15T00:50:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57112025-01-15T00:50:22.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57122025-01-15T00:50:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57132025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
57142025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
57152025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57162025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57172025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
57182025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57192025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
57202025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57212025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57222025-01-15T00:50:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57232025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57242025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57252025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57262025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57272025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57282025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57292025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57302025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57312025-01-15T00:50:22.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57322025-01-15T00:50:22.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57332025-01-15T00:50:22.612ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57342025-01-15T00:50:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57352025-01-15T00:50:22.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57362025-01-15T00:50:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57372025-01-15T00:50:22.614ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57382025-01-15T00:50:22.614ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
57392025-01-15T00:50:22.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57402025-01-15T00:50:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57412025-01-15T00:50:22.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57422025-01-15T00:50:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57432025-01-15T00:50:22.616ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.032046ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
57442025-01-15T00:50:22.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57452025-01-15T00:50:22.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57462025-01-15T00:50:22.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57472025-01-15T00:50:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57482025-01-15T00:50:22.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1242, tv_nsec: 948210449 } })
57492025-01-15T00:50:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57502025-01-15T00:50:22.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
57512025-01-15T00:50:22.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57522025-01-15T00:50:22.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57532025-01-15T00:50:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57542025-01-15T00:50:22.649ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57552025-01-15T00:50:22.649ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57562025-01-15T00:50:22.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57572025-01-15T00:50:22.651ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57582025-01-15T00:50:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57592025-01-15T00:50:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
57602025-01-15T00:50:22.652ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57612025-01-15T00:50:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57622025-01-15T00:50:22.654ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57632025-01-15T00:50:22.654ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57642025-01-15T00:50:22.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57652025-01-15T00:50:22.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57662025-01-15T00:50:22.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 47.884502ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57672025-01-15T00:50:22.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57682025-01-15T00:50:22.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57692025-01-15T00:50:22.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57702025-01-15T00:50:22.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57712025-01-15T00:50:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57722025-01-15T00:50:22.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.662807ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
57732025-01-15T00:50:22.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57742025-01-15T00:50:22.658ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57752025-01-15T00:50:22.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57762025-01-15T00:50:22.658ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
57772025-01-15T00:50:22.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57782025-01-15T00:50:22.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57792025-01-15T00:50:22.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57802025-01-15T00:50:22.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57812025-01-15T00:50:22.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57822025-01-15T00:50:22.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.520929ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57832025-01-15T00:50:22.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57842025-01-15T00:50:22.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57852025-01-15T00:50:22.738ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
57862025-01-15T00:50:22.738ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57872025-01-15T00:50:22.738ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18a36769-40a6-456b-9078-7748ff08f17a", "content-length": "26", "date": "Wed, 15 Jan 2025 00:50:21 GMT"} })
57882025-01-15T00:50:22.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57892025-01-15T00:50:22.740ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
57902025-01-15T00:50:22.748ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57912025-01-15T00:50:22.748ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57922025-01-15T00:50:22.748ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd329fb4-b42e-44b6-8f40-6dfe1d0e0403", "content-length": "372", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
57932025-01-15T00:50:22.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57942025-01-15T00:50:22.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57952025-01-15T00:50:22.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57962025-01-15T00:50:22.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57972025-01-15T00:50:22.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57982025-01-15T00:50:22.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57992025-01-15T00:50:22.765ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
58002025-01-15T00:50:22.765ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 162.788463ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
58012025-01-15T00:50:22.781ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58022025-01-15T00:50:22.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58032025-01-15T00:50:22.784ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58042025-01-15T00:50:22.784ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58052025-01-15T00:50:22.784ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 176.727951ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58062025-01-15T00:50:22.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58072025-01-15T00:50:22.786ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58082025-01-15T00:50:22.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58092025-01-15T00:50:22.786ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58102025-01-15T00:50:22.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58112025-01-15T00:50:22.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58122025-01-15T00:50:22.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58132025-01-15T00:50:22.789ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
58142025-01-15T00:50:22.789ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58152025-01-15T00:50:22.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58162025-01-15T00:50:22.791ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 181.785038ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58172025-01-15T00:50:22.792ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 187.847905ms iteration = 12 status = 0
58182025-01-15T00:50:22.801ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58192025-01-15T00:50:22.801ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 193.474734ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58202025-01-15T00:50:22.803ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58212025-01-15T00:50:22.803ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58222025-01-15T00:50:22.803ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "faea6b0a-b4c3-4821-8902-6eea59f90cbb", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
58232025-01-15T00:50:22.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58242025-01-15T00:50:22.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58252025-01-15T00:50:22.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58262025-01-15T00:50:22.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58272025-01-15T00:50:22.809ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58282025-01-15T00:50:22.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58292025-01-15T00:50:22.813ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58302025-01-15T00:50:22.813ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58312025-01-15T00:50:22.813ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
58322025-01-15T00:50:22.813ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58332025-01-15T00:50:22.813ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f0dcc374-3356-4277-9d80-49dc033863d3", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
58342025-01-15T00:50:22.813ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "131d24ae-84f7-44a8-97e1-34ac63c4210b", "content-length": "26", "date": "Wed, 15 Jan 2025 00:50:21 GMT"} })
58352025-01-15T00:50:22.813ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58362025-01-15T00:50:22.815ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
58372025-01-15T00:50:22.815ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58382025-01-15T00:50:22.815ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a9a7d69-9c0d-4c91-94fc-35ae06a62843", "content-length": "26", "date": "Wed, 15 Jan 2025 00:50:21 GMT"} })
58392025-01-15T00:50:22.815ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58402025-01-15T00:50:22.817ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58412025-01-15T00:50:22.817ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 209.720036ms iteration = 12 status = {}
58422025-01-15T00:50:22.818ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58432025-01-15T00:50:22.822ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58442025-01-15T00:50:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58452025-01-15T00:50:22.826ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58462025-01-15T00:50:22.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58472025-01-15T00:50:22.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 221.504194ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
58482025-01-15T00:50:22.851ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58492025-01-15T00:50:22.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58502025-01-15T00:50:22.857ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
58512025-01-15T00:50:22.857ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 252.368147ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
58522025-01-15T00:50:22.880ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532025-01-15T00:50:22.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58542025-01-15T00:50:22.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58552025-01-15T00:50:22.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58562025-01-15T00:50:22.891ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 287.021754ms iteration = 14 status = {"physical_disks_added":0}
58572025-01-15T00:50:22.899ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
58582025-01-15T00:50:22.899ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb3c9a53-5208-4885-b708-e8a5f331f93b", "content-length": "1", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
58592025-01-15T00:50:22.901ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58602025-01-15T00:50:22.901ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 299.031745ms iteration = 12 status = {}
58612025-01-15T00:50:22.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58622025-01-15T00:50:22.903ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 301.152956ms iteration = 12 status = null
58632025-01-15T00:50:22.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58642025-01-15T00:50:22.912ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
58652025-01-15T00:50:22.912ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58662025-01-15T00:50:22.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58672025-01-15T00:50:22.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58682025-01-15T00:50:22.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58692025-01-15T00:50:22.937ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
58702025-01-15T00:50:22.937ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58712025-01-15T00:50:22.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58722025-01-15T00:50:22.946ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58732025-01-15T00:50:22.947ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc6a9e26-76bf-4520-a673-9ed065f8cab7", "content-length": "134", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
58742025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
58752025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
58762025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58772025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58782025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58792025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58802025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58812025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58822025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58832025-01-15T00:50:22.947ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58842025-01-15T00:50:22.948ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
58852025-01-15T00:50:22.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58862025-01-15T00:50:22.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58872025-01-15T00:50:22.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58882025-01-15T00:50:22.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0c159e2e-cb4b-42f8-9b06-cf0fefe3b21e", "content-length": "2", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
58892025-01-15T00:50:22.949ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58902025-01-15T00:50:22.949ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d9f2336-7dd7-4b99-afe8-46bb53e49fb8", "content-length": "51", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
58912025-01-15T00:50:22.949ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
58922025-01-15T00:50:22.949ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58932025-01-15T00:50:23.011ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58942025-01-15T00:50:23.046ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9d565e82-1b9c-40a0-bcc7-97de3b3edb45", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
58952025-01-15T00:50:23.046ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
58962025-01-15T00:50:23.046ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58972025-01-15T00:50:23.046ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f252d65-c27a-4efc-8361-d0bd0f49f80d", "content-length": "691", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
58982025-01-15T00:50:23.046ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
58992025-01-15T00:50:23.046ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
59002025-01-15T00:50:23.046ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
59012025-01-15T00:50:23.046ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e19940da-ee57-4975-a686-b3f7aacdb5d8", "content-length": "682", "date": "Wed, 15 Jan 2025 00:50:22 GMT"} })
59022025-01-15T00:50:23.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59032025-01-15T00:50:23.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59042025-01-15T00:50:23.048ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 440.884815ms iteration = 12 status = {}
59052025-01-15T00:50:23.050ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59062025-01-15T00:50:23.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59072025-01-15T00:50:23.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59082025-01-15T00:50:23.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59092025-01-15T00:50:23.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59102025-01-15T00:50:23.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59112025-01-15T00:50:23.127ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 522.76495ms iteration = 12 status = {}
59122025-01-15T00:50:23.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 681005c5-9421-4d12-8a79-03aced3914c9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
59132025-01-15T00:50:23.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 681005c5-9421-4d12-8a79-03aced3914c9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
59142025-01-15T00:50:23.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3065 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 681005c5-9421-4d12-8a79-03aced3914c9 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
59152025-01-15T00:50:23.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7f41c0be-2119-4c5c-965e-00f53f0e07e2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59162025-01-15T00:50:23.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7f41c0be-2119-4c5c-965e-00f53f0e07e2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59172025-01-15T00:50:23.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1893 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7f41c0be-2119-4c5c-965e-00f53f0e07e2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59182025-01-15T00:50:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 531 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 12699f6f-4887-47a1-a6e3-fcdd8afda2ca response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
59192025-01-15T00:50:24.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d1dc1dae-a01f-47ea-8e6a-6370a8f9bf4b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59202025-01-15T00:50:24.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d1dc1dae-a01f-47ea-8e6a-6370a8f9bf4b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59212025-01-15T00:50:24.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2131 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d1dc1dae-a01f-47ea-8e6a-6370a8f9bf4b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59222025-01-15T00:50:25.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 789c2484-1d25-4b51-ae66-2299dc4fe65e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59232025-01-15T00:50:25.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 789c2484-1d25-4b51-ae66-2299dc4fe65e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59242025-01-15T00:50:25.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3038 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 789c2484-1d25-4b51-ae66-2299dc4fe65e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59252025-01-15T00:50:26.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 69c95438-1082-43fe-a9b1-244f4c9fbad9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59262025-01-15T00:50:26.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 69c95438-1082-43fe-a9b1-244f4c9fbad9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59272025-01-15T00:50:26.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 69c95438-1082-43fe-a9b1-244f4c9fbad9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59282025-01-15T00:50:27.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 115237e0-30d2-4b8d-97de-a48979f8ce65 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59292025-01-15T00:50:27.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 115237e0-30d2-4b8d-97de-a48979f8ce65 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59302025-01-15T00:50:27.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 115237e0-30d2-4b8d-97de-a48979f8ce65 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59312025-01-15T00:50:28.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c3e4fdb4-1efe-41c6-a664-bc0614bc3733 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59322025-01-15T00:50:28.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c3e4fdb4-1efe-41c6-a664-bc0614bc3733 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59332025-01-15T00:50:28.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1822 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c3e4fdb4-1efe-41c6-a664-bc0614bc3733 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59342025-01-15T00:50:29.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 916a47be-01e4-4aec-9c31-eec11576aa6b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59352025-01-15T00:50:29.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 916a47be-01e4-4aec-9c31-eec11576aa6b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59362025-01-15T00:50:29.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2428 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 916a47be-01e4-4aec-9c31-eec11576aa6b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59372025-01-15T00:50:30.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4e7dcb3-056f-48b9-8881-948ecfb237bd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59382025-01-15T00:50:30.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4e7dcb3-056f-48b9-8881-948ecfb237bd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59392025-01-15T00:50:30.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4e7dcb3-056f-48b9-8881-948ecfb237bd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59402025-01-15T00:50:31.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 360990ff-41da-4d69-86ff-3641335b33b0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59412025-01-15T00:50:31.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 360990ff-41da-4d69-86ff-3641335b33b0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59422025-01-15T00:50:31.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 360990ff-41da-4d69-86ff-3641335b33b0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59432025-01-15T00:50:32.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
59442025-01-15T00:50:32.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59452025-01-15T00:50:32.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59462025-01-15T00:50:32.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
59472025-01-15T00:50:32.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59482025-01-15T00:50:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59492025-01-15T00:50:32.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59502025-01-15T00:50:32.635ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59512025-01-15T00:50:32.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59522025-01-15T00:50:32.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59532025-01-15T00:50:32.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59542025-01-15T00:50:32.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59552025-01-15T00:50:32.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59562025-01-15T00:50:32.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59572025-01-15T00:50:32.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.150977ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59582025-01-15T00:50:32.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59592025-01-15T00:50:32.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
59602025-01-15T00:50:32.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59612025-01-15T00:50:32.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59622025-01-15T00:50:32.692ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
59632025-01-15T00:50:32.692ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.510243ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
59642025-01-15T00:50:32.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 53d586f4-b3fb-4063-a951-e6029156ac8c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59652025-01-15T00:50:32.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 53d586f4-b3fb-4063-a951-e6029156ac8c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59662025-01-15T00:50:32.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1880 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 53d586f4-b3fb-4063-a951-e6029156ac8c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59672025-01-15T00:50:33.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f70c3c76-4b6c-4816-8aba-acba3224285a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59682025-01-15T00:50:33.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f70c3c76-4b6c-4816-8aba-acba3224285a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59692025-01-15T00:50:33.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2770 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f70c3c76-4b6c-4816-8aba-acba3224285a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59702025-01-15T00:50:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 570 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 46af747e-c48a-4c9f-8655-30009118786e response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
59712025-01-15T00:50:34.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a87941fd-75dd-45aa-8966-06b9ed676e63 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59722025-01-15T00:50:34.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a87941fd-75dd-45aa-8966-06b9ed676e63 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59732025-01-15T00:50:34.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a87941fd-75dd-45aa-8966-06b9ed676e63 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59742025-01-15T00:50:35.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 490b0b33-bade-48b9-8422-9262c2b3d3a8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59752025-01-15T00:50:35.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 490b0b33-bade-48b9-8422-9262c2b3d3a8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59762025-01-15T00:50:35.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 490b0b33-bade-48b9-8422-9262c2b3d3a8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59772025-01-15T00:50:36.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 250ba11e-8f3e-445f-a54d-30e3efe253c6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59782025-01-15T00:50:36.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 250ba11e-8f3e-445f-a54d-30e3efe253c6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59792025-01-15T00:50:36.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 250ba11e-8f3e-445f-a54d-30e3efe253c6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59802025-01-15T00:50:37.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5684abff-8de8-4910-87cf-18f13c1ad296 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59812025-01-15T00:50:37.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5684abff-8de8-4910-87cf-18f13c1ad296 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59822025-01-15T00:50:37.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5684abff-8de8-4910-87cf-18f13c1ad296 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59832025-01-15T00:50:38.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e2e8bd87-c8fa-4424-85fc-6a4ce4ca7c82 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59842025-01-15T00:50:38.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e2e8bd87-c8fa-4424-85fc-6a4ce4ca7c82 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59852025-01-15T00:50:38.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2022 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e2e8bd87-c8fa-4424-85fc-6a4ce4ca7c82 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59862025-01-15T00:50:39.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a768ebb6-7ab5-4623-ae5a-67c12afdb9d4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59872025-01-15T00:50:39.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a768ebb6-7ab5-4623-ae5a-67c12afdb9d4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59882025-01-15T00:50:39.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a768ebb6-7ab5-4623-ae5a-67c12afdb9d4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59892025-01-15T00:50:40.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bd05096a-1914-4799-adf4-bc041e552364 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59902025-01-15T00:50:40.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bd05096a-1914-4799-adf4-bc041e552364 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59912025-01-15T00:50:40.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2017 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bd05096a-1914-4799-adf4-bc041e552364 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59922025-01-15T00:50:41.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0411ea9b-2380-4f73-ae76-ca7ba4b142c1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59932025-01-15T00:50:41.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0411ea9b-2380-4f73-ae76-ca7ba4b142c1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59942025-01-15T00:50:41.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0411ea9b-2380-4f73-ae76-ca7ba4b142c1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
59952025-01-15T00:50:42.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
59962025-01-15T00:50:42.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59972025-01-15T00:50:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59982025-01-15T00:50:42.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59992025-01-15T00:50:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60002025-01-15T00:50:42.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60012025-01-15T00:50:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60022025-01-15T00:50:42.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
60032025-01-15T00:50:42.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60042025-01-15T00:50:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60052025-01-15T00:50:42.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60062025-01-15T00:50:42.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60072025-01-15T00:50:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60082025-01-15T00:50:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60092025-01-15T00:50:42.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60102025-01-15T00:50:42.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.496857ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60112025-01-15T00:50:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
60122025-01-15T00:50:42.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60132025-01-15T00:50:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60142025-01-15T00:50:42.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
60152025-01-15T00:50:42.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.361543ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
60162025-01-15T00:50:42.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f1ffa488-df01-4919-bf79-91b47c7b4ebb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60172025-01-15T00:50:42.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f1ffa488-df01-4919-bf79-91b47c7b4ebb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60182025-01-15T00:50:42.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f1ffa488-df01-4919-bf79-91b47c7b4ebb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60192025-01-15T00:50:43.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 488780db-0413-429a-9140-24b0e64cb493 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60202025-01-15T00:50:43.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 488780db-0413-429a-9140-24b0e64cb493 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60212025-01-15T00:50:43.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2066 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 488780db-0413-429a-9140-24b0e64cb493 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60222025-01-15T00:50:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 515 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 2562e986-d99b-4e31-afcc-9b839417241e response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
60232025-01-15T00:50:45.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3c20d97f-48fb-49d0-980b-fd809b490967 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60242025-01-15T00:50:45.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3c20d97f-48fb-49d0-980b-fd809b490967 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60252025-01-15T00:50:45.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3c20d97f-48fb-49d0-980b-fd809b490967 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60262025-01-15T00:50:46.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 441108f9-91b3-4f39-9fef-d1b46fb6316a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60272025-01-15T00:50:46.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 441108f9-91b3-4f39-9fef-d1b46fb6316a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60282025-01-15T00:50:46.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1606 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 441108f9-91b3-4f39-9fef-d1b46fb6316a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60292025-01-15T00:50:47.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f2b4e763-6554-46c8-b5a7-27a7ea8cf33f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60302025-01-15T00:50:47.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f2b4e763-6554-46c8-b5a7-27a7ea8cf33f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60312025-01-15T00:50:47.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f2b4e763-6554-46c8-b5a7-27a7ea8cf33f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60322025-01-15T00:50:48.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25a3b138-91b7-4202-bbc7-830f480681a2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60332025-01-15T00:50:48.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25a3b138-91b7-4202-bbc7-830f480681a2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60342025-01-15T00:50:48.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25a3b138-91b7-4202-bbc7-830f480681a2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60352025-01-15T00:50:49.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e9ca9f1-c9f2-42f4-868e-f5bf46d9f99f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60362025-01-15T00:50:49.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e9ca9f1-c9f2-42f4-868e-f5bf46d9f99f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60372025-01-15T00:50:49.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9e9ca9f1-c9f2-42f4-868e-f5bf46d9f99f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60382025-01-15T00:50:49.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5e37a093-6904-473e-ae13-c526c9f80051 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
60392025-01-15T00:50:49.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5e37a093-6904-473e-ae13-c526c9f80051 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
60402025-01-15T00:50:49.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2628 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5e37a093-6904-473e-ae13-c526c9f80051 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
60412025-01-15T00:50:49.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c85270ba-ac0b-4774-b264-977e56679ed9 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
60422025-01-15T00:50:49.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c85270ba-ac0b-4774-b264-977e56679ed9 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
60432025-01-15T00:50:49.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2893 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c85270ba-ac0b-4774-b264-977e56679ed9 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
60442025-01-15T00:50:50.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cc4368fe-a8c0-4307-a0f5-3f9add9b2932 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60452025-01-15T00:50:50.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cc4368fe-a8c0-4307-a0f5-3f9add9b2932 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60462025-01-15T00:50:50.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cc4368fe-a8c0-4307-a0f5-3f9add9b2932 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60472025-01-15T00:50:51.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8f99b416-4500-4174-9bb2-99d93a655ff5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60482025-01-15T00:50:51.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8f99b416-4500-4174-9bb2-99d93a655ff5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60492025-01-15T00:50:51.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8f99b416-4500-4174-9bb2-99d93a655ff5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60502025-01-15T00:50:52.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbd02d6f-2a60-4a2d-9393-8f5f6856425f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60512025-01-15T00:50:52.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbd02d6f-2a60-4a2d-9393-8f5f6856425f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60522025-01-15T00:50:52.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2681 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dbd02d6f-2a60-4a2d-9393-8f5f6856425f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
60532025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
60542025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60552025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
60562025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
60572025-01-15T00:50:52.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
60582025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
60592025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.77\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
60602025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
60612025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60622025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
60632025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
60642025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
60652025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
60662025-01-15T00:50:52.602ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:40:52.602579398 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
60672025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60682025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
60692025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
60702025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60712025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
60722025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
60732025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
60742025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
60752025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
60762025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
60772025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60782025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60792025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60802025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60812025-01-15T00:50:52.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60822025-01-15T00:50:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60832025-01-15T00:50:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60842025-01-15T00:50:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60852025-01-15T00:50:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1272, tv_nsec: 933011876 } })
60862025-01-15T00:50:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1272, tv_nsec: 933186590 } })
60872025-01-15T00:50:52.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
60882025-01-15T00:50:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 971.249\u{b5}s iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
60892025-01-15T00:50:52.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
60902025-01-15T00:50:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.173833ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
60912025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
60922025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
60932025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
60942025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60952025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
60962025-01-15T00:50:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
60972025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
60982025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
60992025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61002025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61012025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
61022025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61032025-01-15T00:50:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61042025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61052025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61062025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61072025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61082025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61092025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61102025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61112025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61122025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61132025-01-15T00:50:52.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1272, tv_nsec: 935168328 } })
61142025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61152025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61162025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61172025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61182025-01-15T00:50:52.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
61192025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61202025-01-15T00:50:52.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61212025-01-15T00:50:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61222025-01-15T00:50:52.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.101669ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61232025-01-15T00:50:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61242025-01-15T00:50:52.607ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:40:52.602579398 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
61252025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.67726ms iteration = 7 status = {"expiration":"2025-01-15T00:40:52.602579398Z","pruned":[]}
61262025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
61272025-01-15T00:50:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61282025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
61292025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61302025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61312025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
61322025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61332025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
61342025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
61352025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61362025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61372025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
61382025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61392025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
61402025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61412025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61422025-01-15T00:50:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1272, tv_nsec: 937466492 } })
61432025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61442025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61452025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61462025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61472025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61482025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61492025-01-15T00:50:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61502025-01-15T00:50:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
61512025-01-15T00:50:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61522025-01-15T00:50:52.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61532025-01-15T00:50:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61542025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61552025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61562025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
61572025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
61582025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
61592025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61602025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61612025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61622025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
61632025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
61642025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
61652025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61662025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
61672025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61682025-01-15T00:50:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61692025-01-15T00:50:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61702025-01-15T00:50:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61712025-01-15T00:50:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61722025-01-15T00:50:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61732025-01-15T00:50:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61742025-01-15T00:50:52.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61752025-01-15T00:50:52.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61762025-01-15T00:50:52.612ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61772025-01-15T00:50:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61782025-01-15T00:50:52.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61792025-01-15T00:50:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61802025-01-15T00:50:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61812025-01-15T00:50:52.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61822025-01-15T00:50:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61832025-01-15T00:50:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61842025-01-15T00:50:52.614ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61852025-01-15T00:50:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61862025-01-15T00:50:52.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61872025-01-15T00:50:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61882025-01-15T00:50:52.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61892025-01-15T00:50:52.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61902025-01-15T00:50:52.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61912025-01-15T00:50:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61922025-01-15T00:50:52.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61932025-01-15T00:50:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61942025-01-15T00:50:52.627ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61952025-01-15T00:50:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61962025-01-15T00:50:52.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61972025-01-15T00:50:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61982025-01-15T00:50:52.630ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61992025-01-15T00:50:52.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62002025-01-15T00:50:52.633ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62012025-01-15T00:50:52.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62022025-01-15T00:50:52.636ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 26.573082ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
62032025-01-15T00:50:52.649ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62042025-01-15T00:50:52.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62052025-01-15T00:50:52.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62062025-01-15T00:50:52.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62072025-01-15T00:50:52.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62082025-01-15T00:50:52.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62092025-01-15T00:50:52.655ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62102025-01-15T00:50:52.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62112025-01-15T00:50:52.657ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62122025-01-15T00:50:52.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62132025-01-15T00:50:52.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62142025-01-15T00:50:52.659ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62152025-01-15T00:50:52.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62162025-01-15T00:50:52.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62172025-01-15T00:50:52.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62182025-01-15T00:50:52.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62192025-01-15T00:50:52.660ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
62202025-01-15T00:50:52.660ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
62212025-01-15T00:50:52.660ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
62222025-01-15T00:50:52.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62232025-01-15T00:50:52.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62242025-01-15T00:50:52.663ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62252025-01-15T00:50:52.664ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62262025-01-15T00:50:52.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62272025-01-15T00:50:52.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62282025-01-15T00:50:52.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62292025-01-15T00:50:52.665ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62302025-01-15T00:50:52.665ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1272, tv_nsec: 995426177 } })
62312025-01-15T00:50:52.665ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
62322025-01-15T00:50:52.666ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62332025-01-15T00:50:52.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62342025-01-15T00:50:52.666ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62352025-01-15T00:50:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62362025-01-15T00:50:52.667ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62372025-01-15T00:50:52.668ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62382025-01-15T00:50:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
62392025-01-15T00:50:52.669ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
62402025-01-15T00:50:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
62412025-01-15T00:50:52.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62422025-01-15T00:50:52.670ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62432025-01-15T00:50:52.670ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62442025-01-15T00:50:52.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62452025-01-15T00:50:52.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62462025-01-15T00:50:52.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62472025-01-15T00:50:52.670ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62482025-01-15T00:50:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62492025-01-15T00:50:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62502025-01-15T00:50:52.671ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62512025-01-15T00:50:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62522025-01-15T00:50:52.672ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62532025-01-15T00:50:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
62542025-01-15T00:50:52.675ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62552025-01-15T00:50:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62562025-01-15T00:50:52.676ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62572025-01-15T00:50:52.676ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62582025-01-15T00:50:52.676ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.624572ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62592025-01-15T00:50:52.677ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.708353ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
62602025-01-15T00:50:52.679ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62612025-01-15T00:50:52.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62622025-01-15T00:50:52.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62632025-01-15T00:50:52.684ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62642025-01-15T00:50:52.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62652025-01-15T00:50:52.684ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62662025-01-15T00:50:52.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62672025-01-15T00:50:52.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62682025-01-15T00:50:52.685ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62692025-01-15T00:50:52.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62702025-01-15T00:50:52.686ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62712025-01-15T00:50:52.687ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 82.347864ms iteration = 4 status = {"nsuccess":5}
62722025-01-15T00:50:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62732025-01-15T00:50:52.688ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62742025-01-15T00:50:52.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62752025-01-15T00:50:52.692ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62762025-01-15T00:50:52.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
62772025-01-15T00:50:52.696ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62782025-01-15T00:50:52.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62792025-01-15T00:50:52.701ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.672675ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
62802025-01-15T00:50:52.702ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62812025-01-15T00:50:52.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62822025-01-15T00:50:52.707ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
62832025-01-15T00:50:52.707ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 104.894309ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
62842025-01-15T00:50:52.709ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62852025-01-15T00:50:52.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62862025-01-15T00:50:52.711ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872025-01-15T00:50:52.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62882025-01-15T00:50:52.714ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62892025-01-15T00:50:52.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62902025-01-15T00:50:52.716ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62912025-01-15T00:50:52.716ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
62922025-01-15T00:50:52.716ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 112.072697ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
62932025-01-15T00:50:52.716ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
62942025-01-15T00:50:52.716ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
62952025-01-15T00:50:52.716ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
62962025-01-15T00:50:52.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62972025-01-15T00:50:52.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62982025-01-15T00:50:52.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62992025-01-15T00:50:52.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63002025-01-15T00:50:52.719ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63012025-01-15T00:50:52.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63022025-01-15T00:50:52.720ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 112.621908ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63032025-01-15T00:50:52.721ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.869281ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63042025-01-15T00:50:52.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63052025-01-15T00:50:52.722ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63062025-01-15T00:50:52.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63072025-01-15T00:50:52.723ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63082025-01-15T00:50:52.723ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63092025-01-15T00:50:52.725ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63102025-01-15T00:50:52.725ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
63112025-01-15T00:50:52.725ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 120.577431ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63122025-01-15T00:50:52.727ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
63132025-01-15T00:50:52.727ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63142025-01-15T00:50:52.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63152025-01-15T00:50:52.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63162025-01-15T00:50:52.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.626983ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63172025-01-15T00:50:52.729ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.760721ms iteration = 13 status = 0
63182025-01-15T00:50:52.729ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
63192025-01-15T00:50:52.729ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63202025-01-15T00:50:52.730ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2c60a7d-a76a-449a-89e5-8347a9a1cf21", "content-length": "26", "date": "Wed, 15 Jan 2025 00:50:51 GMT"} })
63212025-01-15T00:50:52.730ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63222025-01-15T00:50:52.731ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63232025-01-15T00:50:52.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63242025-01-15T00:50:52.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63252025-01-15T00:50:52.731ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63262025-01-15T00:50:52.733ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
63272025-01-15T00:50:52.733ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
63282025-01-15T00:50:52.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63292025-01-15T00:50:52.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63302025-01-15T00:50:52.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63312025-01-15T00:50:52.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63322025-01-15T00:50:52.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63332025-01-15T00:50:52.738ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63342025-01-15T00:50:52.738ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63352025-01-15T00:50:52.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63362025-01-15T00:50:52.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63372025-01-15T00:50:52.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63382025-01-15T00:50:52.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63392025-01-15T00:50:52.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63402025-01-15T00:50:52.741ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
63412025-01-15T00:50:52.741ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63422025-01-15T00:50:52.741ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
63432025-01-15T00:50:52.741ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 138.516635ms iteration = 7 status = {"generation":2}
63442025-01-15T00:50:52.742ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
63452025-01-15T00:50:52.742ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63462025-01-15T00:50:52.743ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ccce713-51bc-4fb9-9ece-8ee7b4af285f", "content-length": "26", "date": "Wed, 15 Jan 2025 00:50:51 GMT"} })
63472025-01-15T00:50:52.743ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63482025-01-15T00:50:52.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63492025-01-15T00:50:52.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63502025-01-15T00:50:52.744ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63512025-01-15T00:50:52.744ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63522025-01-15T00:50:52.744ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.294532ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63532025-01-15T00:50:52.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542025-01-15T00:50:52.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
63552025-01-15T00:50:52.747ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63562025-01-15T00:50:52.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63572025-01-15T00:50:52.757ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63582025-01-15T00:50:52.757ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63592025-01-15T00:50:52.757ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63602025-01-15T00:50:52.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63612025-01-15T00:50:52.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63622025-01-15T00:50:52.760ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63632025-01-15T00:50:52.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63642025-01-15T00:50:52.763ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63652025-01-15T00:50:52.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63662025-01-15T00:50:52.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63672025-01-15T00:50:52.766ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
63682025-01-15T00:50:52.766ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63692025-01-15T00:50:52.766ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
63702025-01-15T00:50:52.766ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 164.297152ms iteration = 7 status = {"generation":1}
63712025-01-15T00:50:52.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 160.979368ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
63722025-01-15T00:50:52.771ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63732025-01-15T00:50:52.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63742025-01-15T00:50:52.773ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63752025-01-15T00:50:52.775ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63762025-01-15T00:50:52.775ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63772025-01-15T00:50:52.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63782025-01-15T00:50:52.780ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63792025-01-15T00:50:52.780ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63802025-01-15T00:50:52.780ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.98906ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63812025-01-15T00:50:52.791ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63822025-01-15T00:50:52.797ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
63832025-01-15T00:50:52.797ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 195.118915ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63842025-01-15T00:50:52.812ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.953112ms iteration = 15 status = {"physical_disks_added":0}
63852025-01-15T00:50:52.816ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
63862025-01-15T00:50:52.816ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 208.795578ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63872025-01-15T00:50:52.887ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
63882025-01-15T00:50:52.887ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3c5edc3a-1eac-4f1d-a7f1-3207ef32c49a", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63892025-01-15T00:50:52.887ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63902025-01-15T00:50:52.889ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ff296304-582c-47a8-8eb4-bc81260f238e", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63912025-01-15T00:50:52.889ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63922025-01-15T00:50:52.891ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
63932025-01-15T00:50:52.891ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 289.42182ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63942025-01-15T00:50:52.907ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63952025-01-15T00:50:52.907ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da942816-883e-4b2b-ba57-53e678e21cb9", "content-length": "1", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
63962025-01-15T00:50:52.908ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63972025-01-15T00:50:52.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63982025-01-15T00:50:52.916ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.89021ms iteration = 13 status = {}
63992025-01-15T00:50:52.933ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
64002025-01-15T00:50:52.933ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64012025-01-15T00:50:52.934ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81df2e53-1c31-4c7b-a277-919bd6e64750", "content-length": "26", "date": "Wed, 15 Jan 2025 00:50:51 GMT"} })
64022025-01-15T00:50:52.934ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64032025-01-15T00:50:52.935ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64042025-01-15T00:50:52.935ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64052025-01-15T00:50:52.935ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
64062025-01-15T00:50:52.935ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9384124f-8d62-4945-aa99-8843c5f9d124", "content-length": "372", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64072025-01-15T00:50:52.936ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64082025-01-15T00:50:52.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64092025-01-15T00:50:52.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64102025-01-15T00:50:52.937ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 335.433576ms iteration = 13 status = null
64112025-01-15T00:50:52.939ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
64122025-01-15T00:50:52.939ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64132025-01-15T00:50:52.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64142025-01-15T00:50:52.969ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64152025-01-15T00:50:52.980ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
64162025-01-15T00:50:52.980ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64172025-01-15T00:50:52.981ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b134937b-9691-4600-aee2-d069c7ca8ccd", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64182025-01-15T00:50:52.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64192025-01-15T00:50:52.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64202025-01-15T00:50:52.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64212025-01-15T00:50:52.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64222025-01-15T00:50:52.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64232025-01-15T00:50:52.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64242025-01-15T00:50:52.990ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64252025-01-15T00:50:52.990ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64262025-01-15T00:50:52.990ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "324726a6-9204-4d95-bd04-e3fd3265aa41", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64272025-01-15T00:50:52.992ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 384.588431ms iteration = 13 status = {}
64282025-01-15T00:50:53.048ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
64292025-01-15T00:50:53.048ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8396339a-e786-4e2b-ac7d-465c097274ce", "date": "Wed, 15 Jan 2025 00:50:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64302025-01-15T00:50:53.048ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64312025-01-15T00:50:53.050ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "79511674-7ca7-4717-a9de-d9ca407a3f6b", "date": "Wed, 15 Jan 2025 00:50:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64322025-01-15T00:50:53.050ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64332025-01-15T00:50:53.052ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b7d6c9a7-7d74-4150-a079-d727fcc80df5", "date": "Wed, 15 Jan 2025 00:50:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64342025-01-15T00:50:53.052ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64352025-01-15T00:50:53.054ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64362025-01-15T00:50:53.054ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 452.219163ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64372025-01-15T00:50:53.078ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64382025-01-15T00:50:53.078ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fff77e38-8518-4ed3-aae8-69ca04e99ad8", "content-length": "691", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64392025-01-15T00:50:53.078ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
64402025-01-15T00:50:53.078ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
64412025-01-15T00:50:53.078ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
64422025-01-15T00:50:53.080ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 472.83851ms iteration = 13 status = {}
64432025-01-15T00:50:53.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64442025-01-15T00:50:53.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64452025-01-15T00:50:53.109ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
64462025-01-15T00:50:53.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64472025-01-15T00:50:53.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64482025-01-15T00:50:53.119ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64492025-01-15T00:50:53.119ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3951884b-1d23-4edf-8307-41bda47f02df", "content-length": "134", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64502025-01-15T00:50:53.119ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64512025-01-15T00:50:53.119ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
64522025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
64532025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64542025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64552025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64562025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64572025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64582025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
64592025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
64602025-01-15T00:50:53.120ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
64612025-01-15T00:50:53.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64622025-01-15T00:50:53.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64632025-01-15T00:50:53.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64642025-01-15T00:50:53.122ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "318c8018-847a-4dcb-8962-a76dcd63ff40", "content-length": "2", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64652025-01-15T00:50:53.122ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64662025-01-15T00:50:53.122ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8491ed52-3044-472c-a769-8f250d9d6a2d", "content-length": "51", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64672025-01-15T00:50:53.122ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
64682025-01-15T00:50:53.122ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64692025-01-15T00:50:53.215ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9b2868b7-d081-40b8-8a26-d6ce2249455e", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64702025-01-15T00:50:53.215ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
64712025-01-15T00:50:53.215ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64722025-01-15T00:50:53.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d53d8f0-c460-43f4-a9b6-07fa2af55306 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
64732025-01-15T00:50:53.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d53d8f0-c460-43f4-a9b6-07fa2af55306 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
64742025-01-15T00:50:53.216ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e216b8b2-2440-4f66-b742-e0df2a394373", "content-length": "682", "date": "Wed, 15 Jan 2025 00:50:52 GMT"} })
64752025-01-15T00:50:53.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64762025-01-15T00:50:53.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64772025-01-15T00:50:53.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d53d8f0-c460-43f4-a9b6-07fa2af55306 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
64782025-01-15T00:50:53.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64792025-01-15T00:50:53.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64802025-01-15T00:50:53.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64812025-01-15T00:50:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64822025-01-15T00:50:53.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64832025-01-15T00:50:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64842025-01-15T00:50:53.232ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 627.499726ms iteration = 13 status = {}
64852025-01-15T00:50:53.239ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
64862025-01-15T00:50:53.239ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
64872025-01-15T00:50:53.270ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
64882025-01-15T00:50:53.270ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:42430
64892025-01-15T00:50:53.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:42430 req_id = 3289c495-b931-4720-af66-e3f823df7ca7 roles = RoleSet { roles: {} } uri = /metrics/producers
64902025-01-15T00:50:53.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:42430 req_id = 3289c495-b931-4720-af66-e3f823df7ca7 resource = Database result = Ok(()) uri = /metrics/producers
64912025-01-15T00:50:53.309ZINFOnexus: assigned collector to new producer collector_id = dee7453b-558a-4d94-b6a0-8b27cb27f002 file = nexus/src/app/oximeter.rs:76 producer_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
64922025-01-15T00:50:53.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39210 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:42430 req_id = 3289c495-b931-4720-af66-e3f823df7ca7 response_code = 201 uri = /metrics/producers
64932025-01-15T00:50:53.309ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "3289c495-b931-4720-af66-e3f823df7ca7", "content-length": "41", "date": "Wed, 15 Jan 2025 00:50:53 GMT"} })
64942025-01-15T00:50:53.312ZDEBGnexus (producer-registration-task): registered with nexus successfully
64952025-01-15T00:50:53.312ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
64962025-01-15T00:50:53.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 854a77a9-0ced-43f3-af9d-000bbde993ea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
64972025-01-15T00:50:53.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 854a77a9-0ced-43f3-af9d-000bbde993ea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
64982025-01-15T00:50:53.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3427 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 854a77a9-0ced-43f3-af9d-000bbde993ea response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
64992025-01-15T00:50:54.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a374b5a-c380-4821-a3c1-ec8832c8384d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65002025-01-15T00:50:54.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a374b5a-c380-4821-a3c1-ec8832c8384d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65012025-01-15T00:50:54.238ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a374b5a-c380-4821-a3c1-ec8832c8384d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65022025-01-15T00:50:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 523 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 4ca93dab-fb6a-43fd-940e-c0e5dd7e81f6 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
65032025-01-15T00:50:55.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1b73b3da-be4c-4bc5-90d3-c43e9de41205 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65042025-01-15T00:50:55.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1b73b3da-be4c-4bc5-90d3-c43e9de41205 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65052025-01-15T00:50:55.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1762 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1b73b3da-be4c-4bc5-90d3-c43e9de41205 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65062025-01-15T00:50:56.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1c06c961-9102-4c6d-82f6-171c9fce5e0c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65072025-01-15T00:50:56.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1c06c961-9102-4c6d-82f6-171c9fce5e0c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65082025-01-15T00:50:56.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1c06c961-9102-4c6d-82f6-171c9fce5e0c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65092025-01-15T00:50:57.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = af3f746e-9822-436b-a2fe-a19d6ab384e3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65102025-01-15T00:50:57.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = af3f746e-9822-436b-a2fe-a19d6ab384e3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65112025-01-15T00:50:57.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1961 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = af3f746e-9822-436b-a2fe-a19d6ab384e3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65122025-01-15T00:50:58.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b2d3fad5-de07-4ced-a209-1886c28c6e49 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65132025-01-15T00:50:58.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b2d3fad5-de07-4ced-a209-1886c28c6e49 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65142025-01-15T00:50:58.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b2d3fad5-de07-4ced-a209-1886c28c6e49 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65152025-01-15T00:50:59.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 162ba80d-c1bf-4000-9e8b-88c89c8a6e4d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65162025-01-15T00:50:59.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 162ba80d-c1bf-4000-9e8b-88c89c8a6e4d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65172025-01-15T00:50:59.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2349 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 162ba80d-c1bf-4000-9e8b-88c89c8a6e4d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65182025-01-15T00:51:00.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f4159756-ac8e-4ef5-bc08-c5b7b923fcc6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65192025-01-15T00:51:00.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f4159756-ac8e-4ef5-bc08-c5b7b923fcc6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65202025-01-15T00:51:00.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f4159756-ac8e-4ef5-bc08-c5b7b923fcc6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65212025-01-15T00:51:01.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8a377df0-8511-40b4-8119-71cbea7f2b48 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65222025-01-15T00:51:01.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8a377df0-8511-40b4-8119-71cbea7f2b48 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65232025-01-15T00:51:01.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1979 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8a377df0-8511-40b4-8119-71cbea7f2b48 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65242025-01-15T00:51:02.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 42ef72d6-872f-4add-b832-b66fb4854953 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65252025-01-15T00:51:02.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 42ef72d6-872f-4add-b832-b66fb4854953 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65262025-01-15T00:51:02.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 42ef72d6-872f-4add-b832-b66fb4854953 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65272025-01-15T00:51:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
65282025-01-15T00:51:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65292025-01-15T00:51:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65302025-01-15T00:51:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65312025-01-15T00:51:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
65322025-01-15T00:51:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65332025-01-15T00:51:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65342025-01-15T00:51:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65352025-01-15T00:51:02.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65362025-01-15T00:51:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65372025-01-15T00:51:02.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65382025-01-15T00:51:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65392025-01-15T00:51:02.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65402025-01-15T00:51:02.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65412025-01-15T00:51:02.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65422025-01-15T00:51:02.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
65432025-01-15T00:51:02.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65442025-01-15T00:51:02.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65452025-01-15T00:51:02.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
65462025-01-15T00:51:02.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.965922ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
65472025-01-15T00:51:02.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.071467ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65482025-01-15T00:51:03.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3eed1ce0-16cd-4898-a8c6-9d76068ba3b6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65492025-01-15T00:51:03.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3eed1ce0-16cd-4898-a8c6-9d76068ba3b6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65502025-01-15T00:51:03.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3eed1ce0-16cd-4898-a8c6-9d76068ba3b6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65512025-01-15T00:51:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 551 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 04b9c2ff-0bbb-4465-813d-489df4489a7b response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
65522025-01-15T00:51:04.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9414d66-96a4-40a7-b57c-7fb2c9cef6d6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65532025-01-15T00:51:04.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9414d66-96a4-40a7-b57c-7fb2c9cef6d6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65542025-01-15T00:51:04.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9414d66-96a4-40a7-b57c-7fb2c9cef6d6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65552025-01-15T00:51:05.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2abfbd5-1f5e-4aab-ac9f-2ef08707696b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65562025-01-15T00:51:05.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2abfbd5-1f5e-4aab-ac9f-2ef08707696b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65572025-01-15T00:51:05.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2abfbd5-1f5e-4aab-ac9f-2ef08707696b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65582025-01-15T00:51:06.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f483cb1-9aa7-46d4-902d-634eeaaccd07 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65592025-01-15T00:51:06.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f483cb1-9aa7-46d4-902d-634eeaaccd07 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65602025-01-15T00:51:06.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4f483cb1-9aa7-46d4-902d-634eeaaccd07 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65612025-01-15T00:51:07.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 01989ba6-94ac-4791-8469-100503365eff roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65622025-01-15T00:51:07.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 01989ba6-94ac-4791-8469-100503365eff resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65632025-01-15T00:51:07.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 01989ba6-94ac-4791-8469-100503365eff response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65642025-01-15T00:51:08.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 31c362c3-0ee5-41a5-90d5-b356777b7cd3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65652025-01-15T00:51:08.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 31c362c3-0ee5-41a5-90d5-b356777b7cd3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65662025-01-15T00:51:08.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 31c362c3-0ee5-41a5-90d5-b356777b7cd3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65672025-01-15T00:51:09.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 05720f29-cb14-4687-91cf-e08d9ecb976d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65682025-01-15T00:51:09.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 05720f29-cb14-4687-91cf-e08d9ecb976d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65692025-01-15T00:51:09.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1845 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 05720f29-cb14-4687-91cf-e08d9ecb976d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65702025-01-15T00:51:10.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd3f8254-2889-49c2-b5bb-7d45237aa1bc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65712025-01-15T00:51:10.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd3f8254-2889-49c2-b5bb-7d45237aa1bc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65722025-01-15T00:51:10.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2375 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd3f8254-2889-49c2-b5bb-7d45237aa1bc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65732025-01-15T00:51:11.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 55b950b4-3bff-4db8-8c02-452d17634ad7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65742025-01-15T00:51:11.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 55b950b4-3bff-4db8-8c02-452d17634ad7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65752025-01-15T00:51:11.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 55b950b4-3bff-4db8-8c02-452d17634ad7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65762025-01-15T00:51:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
65772025-01-15T00:51:12.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65782025-01-15T00:51:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65792025-01-15T00:51:12.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65802025-01-15T00:51:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65812025-01-15T00:51:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65822025-01-15T00:51:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65832025-01-15T00:51:12.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
65842025-01-15T00:51:12.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65852025-01-15T00:51:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65862025-01-15T00:51:12.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65872025-01-15T00:51:12.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65882025-01-15T00:51:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65892025-01-15T00:51:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65902025-01-15T00:51:12.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65912025-01-15T00:51:12.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.844254ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65922025-01-15T00:51:12.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
65932025-01-15T00:51:12.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65942025-01-15T00:51:12.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65952025-01-15T00:51:12.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
65962025-01-15T00:51:12.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.964744ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
65972025-01-15T00:51:12.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bcbb4147-c0e5-47b3-a0c7-980b19c11192 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65982025-01-15T00:51:12.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bcbb4147-c0e5-47b3-a0c7-980b19c11192 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
65992025-01-15T00:51:12.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bcbb4147-c0e5-47b3-a0c7-980b19c11192 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66002025-01-15T00:51:13.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 961cbf8c-a02e-4341-a756-7d6b1017f338 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66012025-01-15T00:51:13.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 961cbf8c-a02e-4341-a756-7d6b1017f338 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66022025-01-15T00:51:13.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2077 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 961cbf8c-a02e-4341-a756-7d6b1017f338 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66032025-01-15T00:51:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 610 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = b7c659ce-7327-483c-a462-4a8b55265325 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
66042025-01-15T00:51:14.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9c009111-7d31-4ed5-b86f-be25541d0579 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66052025-01-15T00:51:14.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9c009111-7d31-4ed5-b86f-be25541d0579 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66062025-01-15T00:51:14.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9c009111-7d31-4ed5-b86f-be25541d0579 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66072025-01-15T00:51:15.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 713df293-b3bb-4ba7-afde-71bcdb5b4b6a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66082025-01-15T00:51:15.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 713df293-b3bb-4ba7-afde-71bcdb5b4b6a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66092025-01-15T00:51:15.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 713df293-b3bb-4ba7-afde-71bcdb5b4b6a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66102025-01-15T00:51:16.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4da3998f-1f70-4f2a-a8de-b1252e404e2a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66112025-01-15T00:51:16.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4da3998f-1f70-4f2a-a8de-b1252e404e2a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66122025-01-15T00:51:16.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4da3998f-1f70-4f2a-a8de-b1252e404e2a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66132025-01-15T00:51:17.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c7edc26-53d6-4685-8568-6d01cddd2fb4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66142025-01-15T00:51:17.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c7edc26-53d6-4685-8568-6d01cddd2fb4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66152025-01-15T00:51:17.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c7edc26-53d6-4685-8568-6d01cddd2fb4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66162025-01-15T00:51:18.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00196d23-85de-47b8-8b0c-ae5c4aecad22 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66172025-01-15T00:51:18.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00196d23-85de-47b8-8b0c-ae5c4aecad22 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66182025-01-15T00:51:18.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1991 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00196d23-85de-47b8-8b0c-ae5c4aecad22 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66192025-01-15T00:51:19.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = bea11fc3-56f0-4eb7-9728-97ce98de3493 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
66202025-01-15T00:51:19.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = bea11fc3-56f0-4eb7-9728-97ce98de3493 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
66212025-01-15T00:51:19.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3248 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = bea11fc3-56f0-4eb7-9728-97ce98de3493 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
66222025-01-15T00:51:19.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = f76972be-1bc5-4ba3-9135-6267d7342582 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
66232025-01-15T00:51:19.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = f76972be-1bc5-4ba3-9135-6267d7342582 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
66242025-01-15T00:51:19.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = f76972be-1bc5-4ba3-9135-6267d7342582 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
66252025-01-15T00:51:19.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6c8313b2-a02b-4e61-bec4-0bc767579b9e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66262025-01-15T00:51:19.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6c8313b2-a02b-4e61-bec4-0bc767579b9e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66272025-01-15T00:51:19.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2148 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6c8313b2-a02b-4e61-bec4-0bc767579b9e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66282025-01-15T00:51:20.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9b1c4ed2-9f9a-4235-8a58-052215f20a81 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66292025-01-15T00:51:20.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9b1c4ed2-9f9a-4235-8a58-052215f20a81 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66302025-01-15T00:51:20.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9b1c4ed2-9f9a-4235-8a58-052215f20a81 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66312025-01-15T00:51:21.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f09152be-f0ff-4a22-83ac-1d05db0efd73 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66322025-01-15T00:51:21.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f09152be-f0ff-4a22-83ac-1d05db0efd73 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66332025-01-15T00:51:21.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f09152be-f0ff-4a22-83ac-1d05db0efd73 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
66342025-01-15T00:51:22.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
66352025-01-15T00:51:22.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
66362025-01-15T00:51:22.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66372025-01-15T00:51:22.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66382025-01-15T00:51:22.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
66392025-01-15T00:51:22.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
66402025-01-15T00:51:22.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66412025-01-15T00:51:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66422025-01-15T00:51:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66432025-01-15T00:51:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66442025-01-15T00:51:22.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
66452025-01-15T00:51:22.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
66462025-01-15T00:51:22.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
66472025-01-15T00:51:22.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66482025-01-15T00:51:22.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66492025-01-15T00:51:22.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66502025-01-15T00:51:22.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
66512025-01-15T00:51:22.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
66522025-01-15T00:51:22.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66532025-01-15T00:51:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66542025-01-15T00:51:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66552025-01-15T00:51:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66562025-01-15T00:51:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
66572025-01-15T00:51:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1302, tv_nsec: 935579846 } })
66582025-01-15T00:51:22.605ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.075449ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66592025-01-15T00:51:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
66602025-01-15T00:51:22.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66612025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66622025-01-15T00:51:22.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1302, tv_nsec: 937258448 } })
66632025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
66642025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
66652025-01-15T00:51:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66662025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66672025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66682025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66692025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
66702025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66712025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
66722025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
66732025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
66742025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66752025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66762025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66772025-01-15T00:51:22.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
66782025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66792025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66802025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66812025-01-15T00:51:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66822025-01-15T00:51:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66832025-01-15T00:51:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66842025-01-15T00:51:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66852025-01-15T00:51:22.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66862025-01-15T00:51:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66872025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
66882025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66892025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66902025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
66912025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
66922025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
66932025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66942025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
66952025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66962025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
66972025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66982025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66992025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67002025-01-15T00:51:22.609ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67012025-01-15T00:51:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67022025-01-15T00:51:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67032025-01-15T00:51:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67042025-01-15T00:51:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67052025-01-15T00:51:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67062025-01-15T00:51:22.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67072025-01-15T00:51:22.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67082025-01-15T00:51:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
67092025-01-15T00:51:22.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67102025-01-15T00:51:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67112025-01-15T00:51:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67122025-01-15T00:51:22.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67132025-01-15T00:51:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67142025-01-15T00:51:22.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67152025-01-15T00:51:22.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67162025-01-15T00:51:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67172025-01-15T00:51:22.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67182025-01-15T00:51:22.616ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67192025-01-15T00:51:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67202025-01-15T00:51:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67212025-01-15T00:51:22.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67222025-01-15T00:51:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67232025-01-15T00:51:22.617ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1302, tv_nsec: 946862393 } })
67242025-01-15T00:51:22.617ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
67252025-01-15T00:51:22.618ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67262025-01-15T00:51:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67272025-01-15T00:51:22.620ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67282025-01-15T00:51:22.620ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67292025-01-15T00:51:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67302025-01-15T00:51:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67312025-01-15T00:51:22.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67322025-01-15T00:51:22.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67332025-01-15T00:51:22.622ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 15.365666ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67342025-01-15T00:51:22.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67352025-01-15T00:51:22.623ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67362025-01-15T00:51:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67372025-01-15T00:51:22.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67382025-01-15T00:51:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
67392025-01-15T00:51:22.626ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67402025-01-15T00:51:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67412025-01-15T00:51:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67422025-01-15T00:51:22.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67432025-01-15T00:51:22.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67442025-01-15T00:51:22.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67452025-01-15T00:51:22.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67462025-01-15T00:51:22.656ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67472025-01-15T00:51:22.656ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67482025-01-15T00:51:22.656ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67492025-01-15T00:51:22.656ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67502025-01-15T00:51:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67512025-01-15T00:51:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67522025-01-15T00:51:22.659ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 49.963412ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
67532025-01-15T00:51:22.660ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67542025-01-15T00:51:22.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
67552025-01-15T00:51:22.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67562025-01-15T00:51:22.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67572025-01-15T00:51:22.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67582025-01-15T00:51:22.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67592025-01-15T00:51:22.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67602025-01-15T00:51:22.665ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67612025-01-15T00:51:22.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67622025-01-15T00:51:22.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67632025-01-15T00:51:22.667ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67642025-01-15T00:51:22.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67652025-01-15T00:51:22.669ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67662025-01-15T00:51:22.669ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.789609ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67672025-01-15T00:51:22.671ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
67682025-01-15T00:51:22.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 61.645246ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
67692025-01-15T00:51:22.671ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 66.601931ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
67702025-01-15T00:51:22.679ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
67712025-01-15T00:51:22.679ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67722025-01-15T00:51:22.679ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "239f1d70-7f14-45b2-b8b1-558d86cae023", "content-length": "26", "date": "Wed, 15 Jan 2025 00:51:21 GMT"} })
67732025-01-15T00:51:22.679ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67742025-01-15T00:51:22.681ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
67752025-01-15T00:51:22.681ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.589522ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
67762025-01-15T00:51:22.681ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67772025-01-15T00:51:22.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67782025-01-15T00:51:22.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
67792025-01-15T00:51:22.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67802025-01-15T00:51:22.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67812025-01-15T00:51:22.689ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 84.939654ms iteration = 14 status = 0
67822025-01-15T00:51:22.693ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67832025-01-15T00:51:22.693ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67842025-01-15T00:51:22.693ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67852025-01-15T00:51:22.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67862025-01-15T00:51:22.696ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67872025-01-15T00:51:22.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67882025-01-15T00:51:22.698ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.201465ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67892025-01-15T00:51:22.699ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
67902025-01-15T00:51:22.699ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67912025-01-15T00:51:22.699ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 89.629865ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67922025-01-15T00:51:22.699ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "78a85fd2-07c2-49de-b918-b97157d5ba4f", "content-length": "26", "date": "Wed, 15 Jan 2025 00:51:21 GMT"} })
67932025-01-15T00:51:22.699ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
67942025-01-15T00:51:22.699ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67952025-01-15T00:51:22.699ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67962025-01-15T00:51:22.699ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d867551-716a-4d12-a36d-4e73186f1e14", "content-length": "26", "date": "Wed, 15 Jan 2025 00:51:21 GMT"} })
67972025-01-15T00:51:22.699ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67982025-01-15T00:51:22.703ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
67992025-01-15T00:51:22.703ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68002025-01-15T00:51:22.723ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68012025-01-15T00:51:22.723ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68022025-01-15T00:51:22.723ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.579305ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68032025-01-15T00:51:22.723ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68042025-01-15T00:51:22.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68052025-01-15T00:51:22.728ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 118.213126ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68062025-01-15T00:51:22.737ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.742795ms iteration = 16 status = {"physical_disks_added":0}
68072025-01-15T00:51:22.785ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68082025-01-15T00:51:22.785ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68092025-01-15T00:51:22.785ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c9e60e9-cb00-478c-9907-dc4051c3a30b", "content-length": "372", "date": "Wed, 15 Jan 2025 00:51:22 GMT"} })
68102025-01-15T00:51:22.785ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68112025-01-15T00:51:22.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68122025-01-15T00:51:22.795ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68132025-01-15T00:51:22.795ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd19f70a-e890-45a4-b11c-3a9dcfdc3a10", "content-length": "1", "date": "Wed, 15 Jan 2025 00:51:21 GMT"} })
68142025-01-15T00:51:22.797ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68152025-01-15T00:51:22.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68162025-01-15T00:51:22.799ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 197.155494ms iteration = 14 status = null
68172025-01-15T00:51:22.809ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 206.261289ms iteration = 14 status = {}
68182025-01-15T00:51:22.834ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
68192025-01-15T00:51:22.834ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68202025-01-15T00:51:22.834ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e100215b-abd8-4d15-94ea-1d8385b67ce8", "date": "Wed, 15 Jan 2025 00:51:22 GMT"} })
68212025-01-15T00:51:22.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68222025-01-15T00:51:22.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68232025-01-15T00:51:22.836ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68242025-01-15T00:51:22.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68252025-01-15T00:51:22.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68262025-01-15T00:51:22.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68272025-01-15T00:51:22.843ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68282025-01-15T00:51:22.843ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68292025-01-15T00:51:22.844ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "08a0a138-eb84-4b78-a82f-e908fe171f4e", "date": "Wed, 15 Jan 2025 00:51:22 GMT"} })
68302025-01-15T00:51:22.845ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 238.065012ms iteration = 14 status = {}
68312025-01-15T00:51:22.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 16194071-f5b1-49b1-81cf-1a10b02aad41 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68322025-01-15T00:51:22.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 16194071-f5b1-49b1-81cf-1a10b02aad41 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68332025-01-15T00:51:22.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1739 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 16194071-f5b1-49b1-81cf-1a10b02aad41 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68342025-01-15T00:51:22.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68352025-01-15T00:51:22.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68362025-01-15T00:51:22.870ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
68372025-01-15T00:51:22.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68382025-01-15T00:51:22.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68392025-01-15T00:51:22.879ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68402025-01-15T00:51:22.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68412025-01-15T00:51:22.880ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68422025-01-15T00:51:22.880ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cdc2fbf1-ca61-49ad-a9ad-2b5b8852f214", "content-length": "134", "date": "Wed, 15 Jan 2025 00:51:21 GMT"} })
68432025-01-15T00:51:22.880ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68442025-01-15T00:51:22.880ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
68452025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68462025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68472025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68482025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68492025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68502025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68512025-01-15T00:51:22.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68522025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68532025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68542025-01-15T00:51:22.881ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
68552025-01-15T00:51:22.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68562025-01-15T00:51:22.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68572025-01-15T00:51:22.883ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68582025-01-15T00:51:22.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68592025-01-15T00:51:22.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68602025-01-15T00:51:22.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68612025-01-15T00:51:22.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "93e4bc79-60c0-4f52-99ee-aa1c904f8c91", "content-length": "2", "date": "Wed, 15 Jan 2025 00:51:21 GMT"} })
68622025-01-15T00:51:22.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68632025-01-15T00:51:22.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ceb9a2ea-ff2c-4d69-8ecb-d75ef249815b", "content-length": "51", "date": "Wed, 15 Jan 2025 00:51:21 GMT"} })
68642025-01-15T00:51:22.883ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
68652025-01-15T00:51:22.883ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68662025-01-15T00:51:22.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68672025-01-15T00:51:22.887ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68682025-01-15T00:51:22.888ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68692025-01-15T00:51:22.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68702025-01-15T00:51:22.975ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68712025-01-15T00:51:22.981ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f0a647b1-8c99-4beb-9121-be45a807a831", "date": "Wed, 15 Jan 2025 00:51:22 GMT"} })
68722025-01-15T00:51:22.982ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
68732025-01-15T00:51:22.982ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68742025-01-15T00:51:22.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b64dfe5-443a-4c44-88eb-31e56d5f5c8a", "content-length": "691", "date": "Wed, 15 Jan 2025 00:51:22 GMT"} })
68752025-01-15T00:51:22.982ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
68762025-01-15T00:51:22.982ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68772025-01-15T00:51:22.982ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68782025-01-15T00:51:22.983ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e5507c4-7791-4854-9a16-062bd98151ae", "content-length": "682", "date": "Wed, 15 Jan 2025 00:51:22 GMT"} })
68792025-01-15T00:51:22.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68802025-01-15T00:51:22.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68812025-01-15T00:51:22.985ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 377.867052ms iteration = 14 status = {}
68822025-01-15T00:51:22.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68832025-01-15T00:51:22.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68842025-01-15T00:51:22.989ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68852025-01-15T00:51:22.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68862025-01-15T00:51:22.991ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68872025-01-15T00:51:22.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68882025-01-15T00:51:22.998ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 393.159386ms iteration = 14 status = {}
68892025-01-15T00:51:23.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 5b29b6a3-7902-406a-912c-7981aa1e066b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
68902025-01-15T00:51:23.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 5b29b6a3-7902-406a-912c-7981aa1e066b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
68912025-01-15T00:51:23.463ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2536 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 5b29b6a3-7902-406a-912c-7981aa1e066b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
68922025-01-15T00:51:23.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 816920f2-edad-48e0-89c6-9139370459be roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68932025-01-15T00:51:23.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 816920f2-edad-48e0-89c6-9139370459be resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68942025-01-15T00:51:23.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2620 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 816920f2-edad-48e0-89c6-9139370459be response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68952025-01-15T00:51:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = b1e7f498-3717-4ebe-86af-4a51c75eddcf response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
68962025-01-15T00:51:24.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c060d58-8028-494c-a667-1583d4251c9e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68972025-01-15T00:51:24.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c060d58-8028-494c-a667-1583d4251c9e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68982025-01-15T00:51:24.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1959 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c060d58-8028-494c-a667-1583d4251c9e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
68992025-01-15T00:51:25.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35fccf83-fd83-48d8-9707-71a5c34624fd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69002025-01-15T00:51:25.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35fccf83-fd83-48d8-9707-71a5c34624fd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69012025-01-15T00:51:25.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2758 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35fccf83-fd83-48d8-9707-71a5c34624fd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69022025-01-15T00:51:26.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 971b7d29-4886-4b05-b52b-a87a8fa9abce roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69032025-01-15T00:51:26.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 971b7d29-4886-4b05-b52b-a87a8fa9abce resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69042025-01-15T00:51:26.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 971b7d29-4886-4b05-b52b-a87a8fa9abce response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69052025-01-15T00:51:27.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eff7b74f-63fb-4c38-bde9-13d4bd140dc7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69062025-01-15T00:51:27.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eff7b74f-63fb-4c38-bde9-13d4bd140dc7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69072025-01-15T00:51:27.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2478 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eff7b74f-63fb-4c38-bde9-13d4bd140dc7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69082025-01-15T00:51:28.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd0bbfed-2af1-45be-8ede-19d546a83bed roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69092025-01-15T00:51:28.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd0bbfed-2af1-45be-8ede-19d546a83bed resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69102025-01-15T00:51:28.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd0bbfed-2af1-45be-8ede-19d546a83bed response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69112025-01-15T00:51:29.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 14d876b0-fe67-4d71-a99e-c072841b1134 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69122025-01-15T00:51:29.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 14d876b0-fe67-4d71-a99e-c072841b1134 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69132025-01-15T00:51:30.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2016 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 14d876b0-fe67-4d71-a99e-c072841b1134 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69142025-01-15T00:51:31.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a3a65ac-a1bd-43ff-a40b-c00fae65a2f8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69152025-01-15T00:51:31.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a3a65ac-a1bd-43ff-a40b-c00fae65a2f8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69162025-01-15T00:51:31.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a3a65ac-a1bd-43ff-a40b-c00fae65a2f8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69172025-01-15T00:51:32.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b2d7611f-eeb4-4d2d-831a-0a79eefbc734 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69182025-01-15T00:51:32.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b2d7611f-eeb4-4d2d-831a-0a79eefbc734 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69192025-01-15T00:51:32.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b2d7611f-eeb4-4d2d-831a-0a79eefbc734 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69202025-01-15T00:51:32.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
69212025-01-15T00:51:32.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69222025-01-15T00:51:32.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69232025-01-15T00:51:32.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69242025-01-15T00:51:32.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69252025-01-15T00:51:32.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69262025-01-15T00:51:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69272025-01-15T00:51:32.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
69282025-01-15T00:51:32.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69292025-01-15T00:51:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69302025-01-15T00:51:32.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69312025-01-15T00:51:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69322025-01-15T00:51:32.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69332025-01-15T00:51:32.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
69342025-01-15T00:51:32.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69352025-01-15T00:51:32.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69362025-01-15T00:51:32.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
69372025-01-15T00:51:32.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.188918ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
69382025-01-15T00:51:32.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69392025-01-15T00:51:32.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69402025-01-15T00:51:32.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.573238ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69412025-01-15T00:51:33.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 889c6344-91a3-411d-905c-e74e69a13e6e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69422025-01-15T00:51:33.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 889c6344-91a3-411d-905c-e74e69a13e6e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69432025-01-15T00:51:33.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 889c6344-91a3-411d-905c-e74e69a13e6e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69442025-01-15T00:51:34.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e21ee9da-2fdc-4568-b773-2970d5551eac roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69452025-01-15T00:51:34.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e21ee9da-2fdc-4568-b773-2970d5551eac resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69462025-01-15T00:51:34.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e21ee9da-2fdc-4568-b773-2970d5551eac response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69472025-01-15T00:51:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 522 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = dadaacf1-72e5-48bb-acc5-2d6014df4291 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
69482025-01-15T00:51:35.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35310d14-9f52-4a54-8ae9-c7396a70f03e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69492025-01-15T00:51:35.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35310d14-9f52-4a54-8ae9-c7396a70f03e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69502025-01-15T00:51:35.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2119 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 35310d14-9f52-4a54-8ae9-c7396a70f03e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69512025-01-15T00:51:36.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 044ce071-1f03-41f2-9fc1-c696350658a8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69522025-01-15T00:51:36.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 044ce071-1f03-41f2-9fc1-c696350658a8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69532025-01-15T00:51:36.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 044ce071-1f03-41f2-9fc1-c696350658a8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69542025-01-15T00:51:37.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 526649dc-e3bd-44d2-9645-8b0111fcd227 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69552025-01-15T00:51:37.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 526649dc-e3bd-44d2-9645-8b0111fcd227 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69562025-01-15T00:51:37.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2932 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 526649dc-e3bd-44d2-9645-8b0111fcd227 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69572025-01-15T00:51:38.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e23a2620-7e90-4936-8819-6234b6090ac8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69582025-01-15T00:51:38.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e23a2620-7e90-4936-8819-6234b6090ac8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69592025-01-15T00:51:38.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2029 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e23a2620-7e90-4936-8819-6234b6090ac8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69602025-01-15T00:51:39.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25d4cd35-b0b7-4daf-a4ca-6c6f1ec6bebd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69612025-01-15T00:51:39.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25d4cd35-b0b7-4daf-a4ca-6c6f1ec6bebd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69622025-01-15T00:51:39.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1697 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25d4cd35-b0b7-4daf-a4ca-6c6f1ec6bebd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69632025-01-15T00:51:40.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60a85f2b-88f7-4578-b177-a88003ca0409 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69642025-01-15T00:51:40.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60a85f2b-88f7-4578-b177-a88003ca0409 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69652025-01-15T00:51:40.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2569 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60a85f2b-88f7-4578-b177-a88003ca0409 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69662025-01-15T00:51:41.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6c34a71f-bff4-432d-8279-feaab94de308 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69672025-01-15T00:51:41.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6c34a71f-bff4-432d-8279-feaab94de308 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69682025-01-15T00:51:41.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2572 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6c34a71f-bff4-432d-8279-feaab94de308 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69692025-01-15T00:51:42.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e36b8b2c-6abf-42b5-9a5c-aba1aa269954 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69702025-01-15T00:51:42.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e36b8b2c-6abf-42b5-9a5c-aba1aa269954 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69712025-01-15T00:51:42.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e36b8b2c-6abf-42b5-9a5c-aba1aa269954 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69722025-01-15T00:51:42.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
69732025-01-15T00:51:42.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69742025-01-15T00:51:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69752025-01-15T00:51:42.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
69762025-01-15T00:51:42.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69772025-01-15T00:51:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69782025-01-15T00:51:42.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69792025-01-15T00:51:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69802025-01-15T00:51:42.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.465316ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69812025-01-15T00:51:42.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69822025-01-15T00:51:42.633ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69832025-01-15T00:51:42.633ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69842025-01-15T00:51:42.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69852025-01-15T00:51:42.635ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69862025-01-15T00:51:42.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69872025-01-15T00:51:42.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69882025-01-15T00:51:42.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
69892025-01-15T00:51:42.640ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69902025-01-15T00:51:42.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69912025-01-15T00:51:42.651ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
69922025-01-15T00:51:42.651ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.453062ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
69932025-01-15T00:51:43.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7b67ea10-e05c-40ae-a10a-29b6baffed8d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69942025-01-15T00:51:43.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7b67ea10-e05c-40ae-a10a-29b6baffed8d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69952025-01-15T00:51:43.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1857 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7b67ea10-e05c-40ae-a10a-29b6baffed8d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69962025-01-15T00:51:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = ad8e3b42-5df5-4090-9d94-8cd2e3bb78cc response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
69972025-01-15T00:51:44.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 39afec30-144e-4383-9ca2-9e9a6b0965eb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69982025-01-15T00:51:44.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 39afec30-144e-4383-9ca2-9e9a6b0965eb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
69992025-01-15T00:51:44.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2865 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 39afec30-144e-4383-9ca2-9e9a6b0965eb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70002025-01-15T00:51:45.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ef8b9d50-eb6f-48ed-8131-ff5e10ab3f9d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70012025-01-15T00:51:45.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ef8b9d50-eb6f-48ed-8131-ff5e10ab3f9d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70022025-01-15T00:51:45.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ef8b9d50-eb6f-48ed-8131-ff5e10ab3f9d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70032025-01-15T00:51:46.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 06665773-3723-41b1-a2a9-94446cda50d0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70042025-01-15T00:51:46.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 06665773-3723-41b1-a2a9-94446cda50d0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70052025-01-15T00:51:46.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 06665773-3723-41b1-a2a9-94446cda50d0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70062025-01-15T00:51:47.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 27d6a5c6-b35d-421e-8be6-cc77887c8330 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70072025-01-15T00:51:47.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 27d6a5c6-b35d-421e-8be6-cc77887c8330 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70082025-01-15T00:51:47.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1937 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 27d6a5c6-b35d-421e-8be6-cc77887c8330 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70092025-01-15T00:51:48.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d1d5480-92bd-4db9-ba94-b69063d72246 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70102025-01-15T00:51:48.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d1d5480-92bd-4db9-ba94-b69063d72246 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70112025-01-15T00:51:48.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1533 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8d1d5480-92bd-4db9-ba94-b69063d72246 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70122025-01-15T00:51:49.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 917064cc-f2e4-4425-9198-8417649a94ef roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
70132025-01-15T00:51:49.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 917064cc-f2e4-4425-9198-8417649a94ef resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
70142025-01-15T00:51:49.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3222 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 917064cc-f2e4-4425-9198-8417649a94ef response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
70152025-01-15T00:51:49.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = e4f80937-e3dd-47a9-90fd-81120386105e roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
70162025-01-15T00:51:49.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = e4f80937-e3dd-47a9-90fd-81120386105e resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
70172025-01-15T00:51:49.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2527 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = e4f80937-e3dd-47a9-90fd-81120386105e response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
70182025-01-15T00:51:49.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e25b9816-c746-45fb-8f1b-97affeabd81f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70192025-01-15T00:51:49.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e25b9816-c746-45fb-8f1b-97affeabd81f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70202025-01-15T00:51:49.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e25b9816-c746-45fb-8f1b-97affeabd81f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70212025-01-15T00:51:50.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa869794-d0ee-4001-b1ba-7ff3ec158aef roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70222025-01-15T00:51:50.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa869794-d0ee-4001-b1ba-7ff3ec158aef resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70232025-01-15T00:51:50.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa869794-d0ee-4001-b1ba-7ff3ec158aef response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70242025-01-15T00:51:51.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 364b2e1d-a6ca-4358-b5f8-1129ee0a4072 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70252025-01-15T00:51:51.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 364b2e1d-a6ca-4358-b5f8-1129ee0a4072 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70262025-01-15T00:51:51.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1853 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 364b2e1d-a6ca-4358-b5f8-1129ee0a4072 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70272025-01-15T00:51:52.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ced5bbb-8c27-4eac-8b8d-646abdfd1ed6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70282025-01-15T00:51:52.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ced5bbb-8c27-4eac-8b8d-646abdfd1ed6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70292025-01-15T00:51:52.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ced5bbb-8c27-4eac-8b8d-646abdfd1ed6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
70302025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
70312025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70322025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
70332025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
70342025-01-15T00:51:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
70352025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.45\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
70362025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
70372025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
70382025-01-15T00:51:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:41:52.603108408 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
70392025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
70402025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
70412025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70422025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
70432025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
70442025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
70452025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70462025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
70472025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
70482025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
70492025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70502025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
70512025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70522025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
70532025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
70542025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
70552025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70562025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
70572025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70582025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
70592025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
70602025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70612025-01-15T00:51:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70622025-01-15T00:51:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1332, tv_nsec: 933612018 } })
70632025-01-15T00:51:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1332, tv_nsec: 933637768 } })
70642025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
70652025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.105781ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
70662025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
70672025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.126841ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
70682025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
70692025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
70702025-01-15T00:51:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
70712025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
70722025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70732025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
70742025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
70752025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70762025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
70772025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70782025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
70792025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
70802025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
70812025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70822025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70832025-01-15T00:51:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70842025-01-15T00:51:52.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
70852025-01-15T00:51:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
70862025-01-15T00:51:52.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1332, tv_nsec: 935559745 } })
70872025-01-15T00:51:52.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
70882025-01-15T00:51:52.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.448746ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
70892025-01-15T00:51:52.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1332, tv_nsec: 936640326 } })
70902025-01-15T00:51:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
70912025-01-15T00:51:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
70922025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
70932025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
70942025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70952025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70962025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
70972025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70982025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
70992025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71002025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
71012025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
71022025-01-15T00:51:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71032025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71042025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71052025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
71062025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71072025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
71082025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
71092025-01-15T00:51:52.607ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:41:52.603108408 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
71102025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.533607ms iteration = 8 status = {"expiration":"2025-01-15T00:41:52.603108408Z","pruned":[]}
71112025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71122025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71132025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71142025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71152025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71162025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71172025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71182025-01-15T00:51:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
71192025-01-15T00:51:52.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71202025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71212025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
71222025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
71232025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71242025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71252025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
71262025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
71272025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
71282025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71292025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
71302025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71312025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
71322025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71332025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
71342025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71352025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71362025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71372025-01-15T00:51:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
71382025-01-15T00:51:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71392025-01-15T00:51:52.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
71402025-01-15T00:51:52.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71412025-01-15T00:51:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71422025-01-15T00:51:52.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
71432025-01-15T00:51:52.611ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71442025-01-15T00:51:52.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71452025-01-15T00:51:52.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71462025-01-15T00:51:52.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71472025-01-15T00:51:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71482025-01-15T00:51:52.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71492025-01-15T00:51:52.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71502025-01-15T00:51:52.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71512025-01-15T00:51:52.614ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71522025-01-15T00:51:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71532025-01-15T00:51:52.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71542025-01-15T00:51:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71552025-01-15T00:51:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71562025-01-15T00:51:52.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71572025-01-15T00:51:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71582025-01-15T00:51:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71592025-01-15T00:51:52.617ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71602025-01-15T00:51:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71612025-01-15T00:51:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
71622025-01-15T00:51:52.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71632025-01-15T00:51:52.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71642025-01-15T00:51:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71652025-01-15T00:51:52.621ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71662025-01-15T00:51:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71672025-01-15T00:51:52.621ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.067352ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
71682025-01-15T00:51:52.621ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71692025-01-15T00:51:52.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71702025-01-15T00:51:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71712025-01-15T00:51:52.626ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71722025-01-15T00:51:52.626ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
71732025-01-15T00:51:52.626ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
71742025-01-15T00:51:52.626ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.854904ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
71752025-01-15T00:51:52.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71762025-01-15T00:51:52.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71772025-01-15T00:51:52.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71782025-01-15T00:51:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71792025-01-15T00:51:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71802025-01-15T00:51:52.627ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1332, tv_nsec: 957629510 } })
71812025-01-15T00:51:52.627ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71822025-01-15T00:51:52.628ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
71832025-01-15T00:51:52.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71842025-01-15T00:51:52.628ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71852025-01-15T00:51:52.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71862025-01-15T00:51:52.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71872025-01-15T00:51:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71882025-01-15T00:51:52.635ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71892025-01-15T00:51:52.635ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.197463ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71902025-01-15T00:51:52.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71912025-01-15T00:51:52.638ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71922025-01-15T00:51:52.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71932025-01-15T00:51:52.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71942025-01-15T00:51:52.665ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952025-01-15T00:51:52.666ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71962025-01-15T00:51:52.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71972025-01-15T00:51:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
71982025-01-15T00:51:52.667ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71992025-01-15T00:51:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72002025-01-15T00:51:52.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72012025-01-15T00:51:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72022025-01-15T00:51:52.668ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
72032025-01-15T00:51:52.669ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
72042025-01-15T00:51:52.669ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
72052025-01-15T00:51:52.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72062025-01-15T00:51:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72072025-01-15T00:51:52.671ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
72082025-01-15T00:51:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72092025-01-15T00:51:52.671ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.000402ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72102025-01-15T00:51:52.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72112025-01-15T00:51:52.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72122025-01-15T00:51:52.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.288138ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
72132025-01-15T00:51:52.673ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72142025-01-15T00:51:52.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
72152025-01-15T00:51:52.676ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
72162025-01-15T00:51:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72172025-01-15T00:51:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72182025-01-15T00:51:52.677ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72192025-01-15T00:51:52.677ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72202025-01-15T00:51:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72212025-01-15T00:51:52.679ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72222025-01-15T00:51:52.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72232025-01-15T00:51:52.680ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72242025-01-15T00:51:52.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72252025-01-15T00:51:52.680ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
72262025-01-15T00:51:52.680ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
72272025-01-15T00:51:52.680ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 76.435891ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
72282025-01-15T00:51:52.681ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72292025-01-15T00:51:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72302025-01-15T00:51:52.683ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72312025-01-15T00:51:52.683ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
72322025-01-15T00:51:52.683ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72332025-01-15T00:51:52.683ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72342025-01-15T00:51:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72352025-01-15T00:51:52.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72362025-01-15T00:51:52.685ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 75.819889ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
72372025-01-15T00:51:52.686ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72382025-01-15T00:51:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72392025-01-15T00:51:52.688ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72402025-01-15T00:51:52.688ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
72412025-01-15T00:51:52.688ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72422025-01-15T00:51:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72432025-01-15T00:51:52.689ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72442025-01-15T00:51:52.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72452025-01-15T00:51:52.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72462025-01-15T00:51:52.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72472025-01-15T00:51:52.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
72482025-01-15T00:51:52.694ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72492025-01-15T00:51:52.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72502025-01-15T00:51:52.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72512025-01-15T00:51:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
72522025-01-15T00:51:52.698ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72532025-01-15T00:51:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
72542025-01-15T00:51:52.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72552025-01-15T00:51:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72562025-01-15T00:51:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72572025-01-15T00:51:52.700ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.952036ms iteration = 15 status = 0
72582025-01-15T00:51:52.704ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72592025-01-15T00:51:52.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72602025-01-15T00:51:52.709ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
72612025-01-15T00:51:52.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.152693ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
72622025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
72632025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
72642025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72652025-01-15T00:51:52.710ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
72662025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 105.99671ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
72672025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72682025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
72692025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
72702025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
72712025-01-15T00:51:52.710ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72722025-01-15T00:51:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72732025-01-15T00:51:52.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72742025-01-15T00:51:52.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72752025-01-15T00:51:52.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
72762025-01-15T00:51:52.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72772025-01-15T00:51:52.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72782025-01-15T00:51:52.717ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72792025-01-15T00:51:52.717ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72802025-01-15T00:51:52.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72812025-01-15T00:51:52.720ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
72822025-01-15T00:51:52.720ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
72832025-01-15T00:51:52.720ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
72842025-01-15T00:51:52.720ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 116.94603ms iteration = 8 status = {"generation":2}
72852025-01-15T00:51:52.721ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
72862025-01-15T00:51:52.721ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
72872025-01-15T00:51:52.721ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72882025-01-15T00:51:52.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72892025-01-15T00:51:52.723ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72902025-01-15T00:51:52.723ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72912025-01-15T00:51:52.723ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.690227ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72922025-01-15T00:51:52.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72932025-01-15T00:51:52.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 116.177536ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72942025-01-15T00:51:52.726ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
72952025-01-15T00:51:52.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72962025-01-15T00:51:52.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72972025-01-15T00:51:52.727ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.153833ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72982025-01-15T00:51:52.728ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
72992025-01-15T00:51:52.728ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
73002025-01-15T00:51:52.728ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
73012025-01-15T00:51:52.728ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 125.327242ms iteration = 8 status = {"generation":1}
73022025-01-15T00:51:52.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73032025-01-15T00:51:52.728ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73042025-01-15T00:51:52.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73052025-01-15T00:51:52.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73062025-01-15T00:51:52.730ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73072025-01-15T00:51:52.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73082025-01-15T00:51:52.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73092025-01-15T00:51:52.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73102025-01-15T00:51:52.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
73112025-01-15T00:51:52.761ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73122025-01-15T00:51:52.761ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "71022a8d-a0ff-4ba4-915d-c1a21e63efa0", "content-length": "26", "date": "Wed, 15 Jan 2025 00:51:51 GMT"} })
73132025-01-15T00:51:52.761ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73142025-01-15T00:51:52.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
73152025-01-15T00:51:52.762ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73162025-01-15T00:51:52.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73172025-01-15T00:51:52.762ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2856def7-fbab-44ca-b6fa-2dfe6bb749da", "content-length": "26", "date": "Wed, 15 Jan 2025 00:51:51 GMT"} })
73182025-01-15T00:51:52.762ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73192025-01-15T00:51:52.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73202025-01-15T00:51:52.767ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73212025-01-15T00:51:52.772ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
73222025-01-15T00:51:52.772ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 164.859512ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
73232025-01-15T00:51:52.773ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.514902ms iteration = 17 status = {"physical_disks_added":0}
73242025-01-15T00:51:52.845ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
73252025-01-15T00:51:52.900ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
73262025-01-15T00:51:52.900ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73272025-01-15T00:51:52.900ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cb2b633-962b-4ca7-b7bb-04529da37141", "content-length": "372", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
73282025-01-15T00:51:52.900ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73292025-01-15T00:51:52.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73302025-01-15T00:51:52.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 292.565961ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
73312025-01-15T00:51:52.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73322025-01-15T00:51:52.902ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332025-01-15T00:51:52.903ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
73342025-01-15T00:51:52.903ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73352025-01-15T00:51:52.903ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6de74495-7853-4131-8c03-d942c7052fcf", "content-length": "26", "date": "Wed, 15 Jan 2025 00:51:51 GMT"} })
73362025-01-15T00:51:52.903ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73372025-01-15T00:51:52.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
73382025-01-15T00:51:52.905ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73392025-01-15T00:51:52.905ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
73402025-01-15T00:51:52.905ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73412025-01-15T00:51:52.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73422025-01-15T00:51:52.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73432025-01-15T00:51:52.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73442025-01-15T00:51:52.930ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
73452025-01-15T00:51:52.931ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c01b656b-46d3-46e6-8340-695bc23cf039", "content-length": "1", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
73462025-01-15T00:51:52.932ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73472025-01-15T00:51:52.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73482025-01-15T00:51:52.935ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 332.043981ms iteration = 15 status = null
73492025-01-15T00:51:52.939ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 336.247501ms iteration = 15 status = {}
73502025-01-15T00:51:52.942ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
73512025-01-15T00:51:52.942ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 339.100956ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
73522025-01-15T00:51:52.952ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
73532025-01-15T00:51:52.952ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
73542025-01-15T00:51:52.953ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "12e23638-2291-46d6-807e-173f6f5ae7e2", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
73552025-01-15T00:51:52.953ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73562025-01-15T00:51:52.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73572025-01-15T00:51:52.956ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73582025-01-15T00:51:52.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73592025-01-15T00:51:52.959ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
73602025-01-15T00:51:53.020ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
73612025-01-15T00:51:53.020ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1173a8c4-2b72-4b8f-a88a-78a985f6947e", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73622025-01-15T00:51:53.020ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73632025-01-15T00:51:53.022ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ab866e37-aaf7-4d41-b759-b0e8b52bcfa3", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73642025-01-15T00:51:53.022ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73652025-01-15T00:51:53.024ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
73662025-01-15T00:51:53.024ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 421.685865ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
73672025-01-15T00:51:53.135ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
73682025-01-15T00:51:53.136ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee70cb91-d557-4aea-8599-83cd959876b5", "content-length": "691", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
73692025-01-15T00:51:53.136ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
73702025-01-15T00:51:53.136ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
73712025-01-15T00:51:53.136ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
73722025-01-15T00:51:53.138ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 530.54215ms iteration = 15 status = {}
73732025-01-15T00:51:53.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73742025-01-15T00:51:53.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73752025-01-15T00:51:53.142ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
73762025-01-15T00:51:53.142ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
73772025-01-15T00:51:53.143ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "accfe6cf-485b-4696-9ab0-ae129e670509", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
73782025-01-15T00:51:53.145ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 538.043395ms iteration = 15 status = {}
73792025-01-15T00:51:53.147ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
73802025-01-15T00:51:53.148ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e5c88b78-24fb-441e-8080-ee97f3e66f3d", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73812025-01-15T00:51:53.148ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73822025-01-15T00:51:53.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "38e35968-e12c-4456-9226-f27ef6a45490", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73832025-01-15T00:51:53.149ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73842025-01-15T00:51:53.150ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "19af6745-a366-4460-9c33-b365ee05ffbd", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73852025-01-15T00:51:53.150ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73862025-01-15T00:51:53.152ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
73872025-01-15T00:51:53.152ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 548.961165ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
73882025-01-15T00:51:53.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73892025-01-15T00:51:53.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73902025-01-15T00:51:53.175ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
73912025-01-15T00:51:53.175ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73922025-01-15T00:51:53.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73932025-01-15T00:51:53.186ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
73942025-01-15T00:51:53.186ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1b8074b-29df-4ae9-a7ab-bf5438986c27", "content-length": "134", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
73952025-01-15T00:51:53.186ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
73962025-01-15T00:51:53.186ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
73972025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
73982025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
73992025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74002025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74012025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74022025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74032025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
74042025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
74052025-01-15T00:51:53.187ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
74062025-01-15T00:51:53.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74072025-01-15T00:51:53.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74082025-01-15T00:51:53.190ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
74092025-01-15T00:51:53.190ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6ac9755-04fd-47ee-9fda-60c3ce5ea659", "content-length": "2", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
74102025-01-15T00:51:53.190ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
74112025-01-15T00:51:53.190ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1110fb4e-5486-4df7-a9ce-8eb157de1edb", "content-length": "51", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
74122025-01-15T00:51:53.190ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
74132025-01-15T00:51:53.190ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
74142025-01-15T00:51:53.280ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "05e7f71f-89c9-48f5-b197-533464ec9dd1", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
74152025-01-15T00:51:53.280ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
74162025-01-15T00:51:53.280ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
74172025-01-15T00:51:53.283ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "05591cd1-fd6e-4da9-8ed5-4bac54221e61", "content-length": "682", "date": "Wed, 15 Jan 2025 00:51:52 GMT"} })
74182025-01-15T00:51:53.283ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74192025-01-15T00:51:53.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74202025-01-15T00:51:53.287ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74212025-01-15T00:51:53.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74222025-01-15T00:51:53.290ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74232025-01-15T00:51:53.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74242025-01-15T00:51:53.292ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74252025-01-15T00:51:53.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74262025-01-15T00:51:53.300ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 695.852912ms iteration = 15 status = {}
74272025-01-15T00:51:53.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 2f411e38-797c-43d0-aee1-e3f9fdb6a533 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
74282025-01-15T00:51:53.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 2f411e38-797c-43d0-aee1-e3f9fdb6a533 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
74292025-01-15T00:51:53.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 2f411e38-797c-43d0-aee1-e3f9fdb6a533 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
74302025-01-15T00:51:53.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8f9f012-6f55-4f54-bf23-e57024904ff3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74312025-01-15T00:51:53.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8f9f012-6f55-4f54-bf23-e57024904ff3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74322025-01-15T00:51:53.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8f9f012-6f55-4f54-bf23-e57024904ff3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74332025-01-15T00:51:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 503 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = bc571a8e-dad6-4470-a8a7-7c4ec5eb861c response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
74342025-01-15T00:51:54.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 529ad398-ac68-4810-818a-c704cc7e0542 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74352025-01-15T00:51:54.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 529ad398-ac68-4810-818a-c704cc7e0542 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74362025-01-15T00:51:54.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 529ad398-ac68-4810-818a-c704cc7e0542 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74372025-01-15T00:51:55.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cb937a44-5ecc-42e3-b4b5-eed8ec9e4fd4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74382025-01-15T00:51:55.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cb937a44-5ecc-42e3-b4b5-eed8ec9e4fd4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74392025-01-15T00:51:55.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1525 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cb937a44-5ecc-42e3-b4b5-eed8ec9e4fd4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74402025-01-15T00:51:56.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a949c6a0-2fad-48e1-8933-aa0d38dcdb8e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74412025-01-15T00:51:56.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a949c6a0-2fad-48e1-8933-aa0d38dcdb8e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74422025-01-15T00:51:56.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a949c6a0-2fad-48e1-8933-aa0d38dcdb8e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74432025-01-15T00:51:57.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e061e3a3-77b4-43df-ab25-f001de057a0d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74442025-01-15T00:51:57.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e061e3a3-77b4-43df-ab25-f001de057a0d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74452025-01-15T00:51:57.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2537 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e061e3a3-77b4-43df-ab25-f001de057a0d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74462025-01-15T00:51:58.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 10185dd8-6e4c-48f2-a7a5-5f7f1c2c4d76 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74472025-01-15T00:51:58.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 10185dd8-6e4c-48f2-a7a5-5f7f1c2c4d76 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74482025-01-15T00:51:58.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 10185dd8-6e4c-48f2-a7a5-5f7f1c2c4d76 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74492025-01-15T00:51:59.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 982e0d40-0fa0-416c-aff6-d7791b77f804 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74502025-01-15T00:51:59.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 982e0d40-0fa0-416c-aff6-d7791b77f804 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74512025-01-15T00:51:59.646ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 982e0d40-0fa0-416c-aff6-d7791b77f804 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74522025-01-15T00:52:00.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 570aa451-0d96-4858-a5a8-f8d89a46c3d6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74532025-01-15T00:52:00.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 570aa451-0d96-4858-a5a8-f8d89a46c3d6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74542025-01-15T00:52:00.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1606 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 570aa451-0d96-4858-a5a8-f8d89a46c3d6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74552025-01-15T00:52:01.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8ef90152-e189-4d02-87f4-d1db26e08486 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74562025-01-15T00:52:01.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8ef90152-e189-4d02-87f4-d1db26e08486 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74572025-01-15T00:52:01.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2221 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8ef90152-e189-4d02-87f4-d1db26e08486 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74582025-01-15T00:52:02.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
74592025-01-15T00:52:02.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74602025-01-15T00:52:02.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74612025-01-15T00:52:02.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74622025-01-15T00:52:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74632025-01-15T00:52:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74642025-01-15T00:52:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74652025-01-15T00:52:02.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
74662025-01-15T00:52:02.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74672025-01-15T00:52:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74682025-01-15T00:52:02.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74692025-01-15T00:52:02.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74702025-01-15T00:52:02.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74712025-01-15T00:52:02.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
74722025-01-15T00:52:02.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74732025-01-15T00:52:02.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74742025-01-15T00:52:02.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
74752025-01-15T00:52:02.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.574283ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
74762025-01-15T00:52:02.636ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74772025-01-15T00:52:02.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74782025-01-15T00:52:02.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.312353ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74792025-01-15T00:52:02.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 550b3ffc-7161-4843-9b45-c158b4c3daa1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74802025-01-15T00:52:02.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 550b3ffc-7161-4843-9b45-c158b4c3daa1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74812025-01-15T00:52:02.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1766 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 550b3ffc-7161-4843-9b45-c158b4c3daa1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74822025-01-15T00:52:03.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5f3c66b3-7108-4583-a2d7-edab6daa588d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74832025-01-15T00:52:03.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5f3c66b3-7108-4583-a2d7-edab6daa588d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74842025-01-15T00:52:03.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5f3c66b3-7108-4583-a2d7-edab6daa588d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74852025-01-15T00:52:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 1805179f-8976-488b-9d29-c5d4e425ad7e response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
74862025-01-15T00:52:04.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b94163c-a823-45f6-a917-49c15cbe1857 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74872025-01-15T00:52:04.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b94163c-a823-45f6-a917-49c15cbe1857 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74882025-01-15T00:52:04.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b94163c-a823-45f6-a917-49c15cbe1857 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74892025-01-15T00:52:05.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f967baab-f552-405e-b58d-4f8d6f3423a7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74902025-01-15T00:52:05.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f967baab-f552-405e-b58d-4f8d6f3423a7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74912025-01-15T00:52:05.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f967baab-f552-405e-b58d-4f8d6f3423a7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74922025-01-15T00:52:06.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e56756d6-bfb7-4635-bb52-cfced873e3da roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74932025-01-15T00:52:06.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e56756d6-bfb7-4635-bb52-cfced873e3da resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74942025-01-15T00:52:06.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2231 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e56756d6-bfb7-4635-bb52-cfced873e3da response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74952025-01-15T00:52:07.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70d40343-a1f4-42d5-9e9f-50c7a5f2789c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74962025-01-15T00:52:07.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70d40343-a1f4-42d5-9e9f-50c7a5f2789c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74972025-01-15T00:52:07.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70d40343-a1f4-42d5-9e9f-50c7a5f2789c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74982025-01-15T00:52:08.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8b925a7-7305-4f5b-af94-a8a170674b4a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
74992025-01-15T00:52:08.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8b925a7-7305-4f5b-af94-a8a170674b4a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75002025-01-15T00:52:08.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8b925a7-7305-4f5b-af94-a8a170674b4a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75012025-01-15T00:52:09.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 17ceec81-d8f5-4c9e-99ed-db34fdd95d6c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75022025-01-15T00:52:09.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 17ceec81-d8f5-4c9e-99ed-db34fdd95d6c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75032025-01-15T00:52:09.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1647 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 17ceec81-d8f5-4c9e-99ed-db34fdd95d6c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75042025-01-15T00:52:10.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dcd5fd92-34c6-4880-a016-8788c7225c2a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75052025-01-15T00:52:10.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dcd5fd92-34c6-4880-a016-8788c7225c2a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75062025-01-15T00:52:10.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dcd5fd92-34c6-4880-a016-8788c7225c2a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75072025-01-15T00:52:11.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5d42621a-b797-4ebc-a52a-110084c51ef6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75082025-01-15T00:52:11.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5d42621a-b797-4ebc-a52a-110084c51ef6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75092025-01-15T00:52:11.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1976 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5d42621a-b797-4ebc-a52a-110084c51ef6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75102025-01-15T00:52:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
75112025-01-15T00:52:12.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75122025-01-15T00:52:12.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75132025-01-15T00:52:12.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75142025-01-15T00:52:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75152025-01-15T00:52:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75162025-01-15T00:52:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75172025-01-15T00:52:12.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
75182025-01-15T00:52:12.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75192025-01-15T00:52:12.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75202025-01-15T00:52:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75212025-01-15T00:52:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75222025-01-15T00:52:12.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75232025-01-15T00:52:12.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75242025-01-15T00:52:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75252025-01-15T00:52:12.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.13524ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75262025-01-15T00:52:12.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
75272025-01-15T00:52:12.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75282025-01-15T00:52:12.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75292025-01-15T00:52:12.624ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
75302025-01-15T00:52:12.624ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.062424ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
75312025-01-15T00:52:12.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdbe747c-aeb8-4f3a-ace3-5374f054f713 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75322025-01-15T00:52:12.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdbe747c-aeb8-4f3a-ace3-5374f054f713 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75332025-01-15T00:52:12.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4854 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdbe747c-aeb8-4f3a-ace3-5374f054f713 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75342025-01-15T00:52:13.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70532d57-37c8-4a7d-b332-7ab17e636ad7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75352025-01-15T00:52:13.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70532d57-37c8-4a7d-b332-7ab17e636ad7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75362025-01-15T00:52:13.953ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70532d57-37c8-4a7d-b332-7ab17e636ad7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75372025-01-15T00:52:14.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 504 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 8b81201e-4ec7-4ff8-bf85-bb8679c34f91 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
75382025-01-15T00:52:14.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 71fbd78f-7bb9-4a7d-a0cc-a68cb4714868 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75392025-01-15T00:52:14.972ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 71fbd78f-7bb9-4a7d-a0cc-a68cb4714868 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75402025-01-15T00:52:14.974ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2352 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 71fbd78f-7bb9-4a7d-a0cc-a68cb4714868 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75412025-01-15T00:52:15.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9bd97813-8824-4b68-9e22-54c33ca89f50 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75422025-01-15T00:52:15.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9bd97813-8824-4b68-9e22-54c33ca89f50 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75432025-01-15T00:52:15.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9bd97813-8824-4b68-9e22-54c33ca89f50 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75442025-01-15T00:52:17.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 532b409d-5f1e-4841-9529-ca13b4bec4e2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75452025-01-15T00:52:17.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 532b409d-5f1e-4841-9529-ca13b4bec4e2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75462025-01-15T00:52:17.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2024 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 532b409d-5f1e-4841-9529-ca13b4bec4e2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75472025-01-15T00:52:18.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b5b5df6-311d-4eab-8f51-f225fdbf27b5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75482025-01-15T00:52:18.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b5b5df6-311d-4eab-8f51-f225fdbf27b5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75492025-01-15T00:52:18.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2123 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5b5b5df6-311d-4eab-8f51-f225fdbf27b5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75502025-01-15T00:52:19.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5da18de9-cad5-450b-824b-bc943cd16bb1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75512025-01-15T00:52:19.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5da18de9-cad5-450b-824b-bc943cd16bb1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75522025-01-15T00:52:19.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2006 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5da18de9-cad5-450b-824b-bc943cd16bb1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75532025-01-15T00:52:20.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 97a170ce-b7f0-4b8b-b983-eed0c412520a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75542025-01-15T00:52:20.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 97a170ce-b7f0-4b8b-b983-eed0c412520a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75552025-01-15T00:52:20.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 97a170ce-b7f0-4b8b-b983-eed0c412520a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75562025-01-15T00:52:21.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94236b8e-e3d1-4366-b187-b087d7ffb39c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75572025-01-15T00:52:21.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94236b8e-e3d1-4366-b187-b087d7ffb39c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75582025-01-15T00:52:21.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1945 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94236b8e-e3d1-4366-b187-b087d7ffb39c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75592025-01-15T00:52:22.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 05d917a7-e6a2-4cc3-85f3-5de9401f3684 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75602025-01-15T00:52:22.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 05d917a7-e6a2-4cc3-85f3-5de9401f3684 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75612025-01-15T00:52:22.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 05d917a7-e6a2-4cc3-85f3-5de9401f3684 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
75622025-01-15T00:52:22.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 26ceffb8-7659-49f8-9d4c-23de53b50be5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
75632025-01-15T00:52:22.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 26ceffb8-7659-49f8-9d4c-23de53b50be5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
75642025-01-15T00:52:22.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 26ceffb8-7659-49f8-9d4c-23de53b50be5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
75652025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
75662025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
75672025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
75682025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
75692025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75702025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75712025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
75722025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75732025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75742025-01-15T00:52:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75752025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
75762025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
75772025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75782025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75792025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
75802025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
75812025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75822025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75832025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75842025-01-15T00:52:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75852025-01-15T00:52:22.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75862025-01-15T00:52:22.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75872025-01-15T00:52:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1362, tv_nsec: 936114216 } })
75882025-01-15T00:52:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
75892025-01-15T00:52:22.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75902025-01-15T00:52:22.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1362, tv_nsec: 937121745 } })
75912025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.042868ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75922025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
75932025-01-15T00:52:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75942025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75952025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
75962025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
75972025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
75982025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
75992025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76002025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
76012025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76022025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
76032025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76042025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
76052025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76062025-01-15T00:52:22.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
76072025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76082025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76092025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76102025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76112025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76122025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76132025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76142025-01-15T00:52:22.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76152025-01-15T00:52:22.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76162025-01-15T00:52:22.608ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76172025-01-15T00:52:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
76182025-01-15T00:52:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
76192025-01-15T00:52:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
76202025-01-15T00:52:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76212025-01-15T00:52:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
76222025-01-15T00:52:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76232025-01-15T00:52:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
76242025-01-15T00:52:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
76252025-01-15T00:52:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76262025-01-15T00:52:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
76272025-01-15T00:52:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
76282025-01-15T00:52:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76292025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76302025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76312025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76322025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76332025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76342025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76352025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76362025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76372025-01-15T00:52:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76382025-01-15T00:52:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76392025-01-15T00:52:22.612ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76402025-01-15T00:52:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76412025-01-15T00:52:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76422025-01-15T00:52:22.612ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76432025-01-15T00:52:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76442025-01-15T00:52:22.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76452025-01-15T00:52:22.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76462025-01-15T00:52:22.614ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76472025-01-15T00:52:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76482025-01-15T00:52:22.615ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76492025-01-15T00:52:22.615ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
76502025-01-15T00:52:22.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76512025-01-15T00:52:22.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76522025-01-15T00:52:22.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76532025-01-15T00:52:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76542025-01-15T00:52:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76552025-01-15T00:52:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76562025-01-15T00:52:22.616ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76572025-01-15T00:52:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76582025-01-15T00:52:22.619ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76592025-01-15T00:52:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76602025-01-15T00:52:22.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76612025-01-15T00:52:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76622025-01-15T00:52:22.620ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1362, tv_nsec: 950481503 } })
76632025-01-15T00:52:22.620ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
76642025-01-15T00:52:22.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76652025-01-15T00:52:22.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76662025-01-15T00:52:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76672025-01-15T00:52:22.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76682025-01-15T00:52:22.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76692025-01-15T00:52:22.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76702025-01-15T00:52:22.626ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76712025-01-15T00:52:22.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76722025-01-15T00:52:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76732025-01-15T00:52:22.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76742025-01-15T00:52:22.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76752025-01-15T00:52:22.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76762025-01-15T00:52:22.642ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 36.37746ms iteration = 18 status = {"physical_disks_added":0}
76772025-01-15T00:52:22.650ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.52637ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
76782025-01-15T00:52:22.653ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76792025-01-15T00:52:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76802025-01-15T00:52:22.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76812025-01-15T00:52:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76822025-01-15T00:52:22.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76832025-01-15T00:52:22.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76842025-01-15T00:52:22.662ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.920559ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
76852025-01-15T00:52:22.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76862025-01-15T00:52:22.663ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
76872025-01-15T00:52:22.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
76882025-01-15T00:52:22.664ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76892025-01-15T00:52:22.664ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76902025-01-15T00:52:22.664ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76912025-01-15T00:52:22.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76922025-01-15T00:52:22.665ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76932025-01-15T00:52:22.665ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76942025-01-15T00:52:22.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76952025-01-15T00:52:22.665ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
76962025-01-15T00:52:22.665ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76972025-01-15T00:52:22.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76982025-01-15T00:52:22.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
76992025-01-15T00:52:22.667ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77002025-01-15T00:52:22.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77012025-01-15T00:52:22.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.350511ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77022025-01-15T00:52:22.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.481753ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77032025-01-15T00:52:22.669ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.39283ms iteration = 16 status = 0
77042025-01-15T00:52:22.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77052025-01-15T00:52:22.671ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77062025-01-15T00:52:22.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77072025-01-15T00:52:22.673ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
77082025-01-15T00:52:22.673ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77092025-01-15T00:52:22.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77102025-01-15T00:52:22.673ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 63.881999ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
77112025-01-15T00:52:22.674ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
77122025-01-15T00:52:22.674ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.256174ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
77132025-01-15T00:52:22.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
77142025-01-15T00:52:22.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.738465ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
77152025-01-15T00:52:22.695ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77162025-01-15T00:52:22.695ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
77172025-01-15T00:52:22.695ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 90.009142ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
77182025-01-15T00:52:22.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77192025-01-15T00:52:22.697ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
77202025-01-15T00:52:22.697ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
77212025-01-15T00:52:22.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 89.812258ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
77222025-01-15T00:52:22.707ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
77232025-01-15T00:52:22.707ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77242025-01-15T00:52:22.707ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3b3c0d7-847c-4327-afcb-a490180b30bc", "content-length": "26", "date": "Wed, 15 Jan 2025 00:52:21 GMT"} })
77252025-01-15T00:52:22.707ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77262025-01-15T00:52:22.708ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
77272025-01-15T00:52:22.708ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77282025-01-15T00:52:22.708ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b20b7bfe-f8f8-458e-a345-4da488a8c053", "content-length": "26", "date": "Wed, 15 Jan 2025 00:52:21 GMT"} })
77292025-01-15T00:52:22.708ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77302025-01-15T00:52:22.709ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77312025-01-15T00:52:22.710ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77322025-01-15T00:52:22.726ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
77332025-01-15T00:52:22.726ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77342025-01-15T00:52:22.726ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54d6f63a-67e5-41fa-b33d-edf6f660ae73", "content-length": "26", "date": "Wed, 15 Jan 2025 00:52:21 GMT"} })
77352025-01-15T00:52:22.726ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77362025-01-15T00:52:22.728ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
77372025-01-15T00:52:22.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.021668ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
77382025-01-15T00:52:22.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77392025-01-15T00:52:22.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77402025-01-15T00:52:22.787ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77412025-01-15T00:52:22.787ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77422025-01-15T00:52:22.787ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c395c7c-b5cd-401c-82ba-531ee5217634", "content-length": "372", "date": "Wed, 15 Jan 2025 00:52:21 GMT"} })
77432025-01-15T00:52:22.787ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77442025-01-15T00:52:22.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77452025-01-15T00:52:22.788ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77462025-01-15T00:52:22.790ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77472025-01-15T00:52:22.790ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77482025-01-15T00:52:22.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77492025-01-15T00:52:22.792ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77502025-01-15T00:52:22.793ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77512025-01-15T00:52:22.793ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77522025-01-15T00:52:22.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77532025-01-15T00:52:22.803ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77542025-01-15T00:52:22.803ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8913482a-17be-4119-9065-f9eaf3652d92", "content-length": "1", "date": "Wed, 15 Jan 2025 00:52:22 GMT"} })
77552025-01-15T00:52:22.806ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 202.913425ms iteration = 16 status = {}
77562025-01-15T00:52:22.806ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77572025-01-15T00:52:22.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77582025-01-15T00:52:22.808ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.953674ms iteration = 16 status = null
77592025-01-15T00:52:22.834ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
77602025-01-15T00:52:22.834ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77612025-01-15T00:52:22.835ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ff308a8d-225b-4aa0-892d-b467273bc09f", "date": "Wed, 15 Jan 2025 00:52:21 GMT"} })
77622025-01-15T00:52:22.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77632025-01-15T00:52:22.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77642025-01-15T00:52:22.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77652025-01-15T00:52:22.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77662025-01-15T00:52:22.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77672025-01-15T00:52:22.840ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77682025-01-15T00:52:22.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77692025-01-15T00:52:22.840ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "46e8509b-af1b-432c-845a-2987b93d21be", "content-length": "691", "date": "Wed, 15 Jan 2025 00:52:21 GMT"} })
77702025-01-15T00:52:22.840ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
77712025-01-15T00:52:22.840ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
77722025-01-15T00:52:22.840ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
77732025-01-15T00:52:22.842ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 234.700366ms iteration = 16 status = {}
77742025-01-15T00:52:22.843ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77752025-01-15T00:52:22.843ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77762025-01-15T00:52:22.843ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bf49d73c-5ddd-438f-9b68-48868be98148", "date": "Wed, 15 Jan 2025 00:52:21 GMT"} })
77772025-01-15T00:52:22.845ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 237.903269ms iteration = 16 status = {}
77782025-01-15T00:52:22.878ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77792025-01-15T00:52:22.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77802025-01-15T00:52:22.880ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
77812025-01-15T00:52:22.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77822025-01-15T00:52:22.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77832025-01-15T00:52:22.889ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77842025-01-15T00:52:22.889ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1cfc6667-cc68-45bd-80b2-56276da82869", "content-length": "134", "date": "Wed, 15 Jan 2025 00:52:22 GMT"} })
77852025-01-15T00:52:22.889ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77862025-01-15T00:52:22.889ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
77872025-01-15T00:52:22.889ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77882025-01-15T00:52:22.889ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77892025-01-15T00:52:22.889ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77902025-01-15T00:52:22.889ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77912025-01-15T00:52:22.889ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77922025-01-15T00:52:22.889ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77932025-01-15T00:52:22.890ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77942025-01-15T00:52:22.890ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77952025-01-15T00:52:22.890ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
77962025-01-15T00:52:22.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77972025-01-15T00:52:22.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77982025-01-15T00:52:22.892ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77992025-01-15T00:52:22.892ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "915b6c16-05fb-4299-b9a4-17d6e04243ee", "content-length": "2", "date": "Wed, 15 Jan 2025 00:52:22 GMT"} })
78002025-01-15T00:52:22.892ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78012025-01-15T00:52:22.892ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "96d79cdf-af39-4aed-ab4a-cb39b159bfe5", "content-length": "51", "date": "Wed, 15 Jan 2025 00:52:22 GMT"} })
78022025-01-15T00:52:22.892ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
78032025-01-15T00:52:22.892ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78042025-01-15T00:52:22.986ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "cc9af319-16ce-4c3b-938c-a909fb02571c", "date": "Wed, 15 Jan 2025 00:52:22 GMT"} })
78052025-01-15T00:52:22.986ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
78062025-01-15T00:52:22.986ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78072025-01-15T00:52:22.986ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d956f227-f82c-41dd-b474-66172d83a161", "content-length": "682", "date": "Wed, 15 Jan 2025 00:52:22 GMT"} })
78082025-01-15T00:52:22.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78092025-01-15T00:52:22.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78102025-01-15T00:52:22.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78112025-01-15T00:52:22.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78122025-01-15T00:52:22.993ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78132025-01-15T00:52:22.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78142025-01-15T00:52:22.995ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78152025-01-15T00:52:22.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78162025-01-15T00:52:23.002ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 396.491551ms iteration = 16 status = {}
78172025-01-15T00:52:23.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b890876-e28e-4cdc-a9d4-e61d74310710 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78182025-01-15T00:52:23.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b890876-e28e-4cdc-a9d4-e61d74310710 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78192025-01-15T00:52:23.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2097 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b890876-e28e-4cdc-a9d4-e61d74310710 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78202025-01-15T00:52:24.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d518d0c-5a8a-45af-be18-42a097e30ce3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78212025-01-15T00:52:24.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d518d0c-5a8a-45af-be18-42a097e30ce3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78222025-01-15T00:52:24.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2229 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d518d0c-5a8a-45af-be18-42a097e30ce3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78232025-01-15T00:52:24.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 990 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = ca45d649-fb50-483e-bed2-c0586bedcae1 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
78242025-01-15T00:52:25.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = feecb7d8-adbb-4f77-b650-9d3d1b817efe roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78252025-01-15T00:52:25.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = feecb7d8-adbb-4f77-b650-9d3d1b817efe resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78262025-01-15T00:52:25.192ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = feecb7d8-adbb-4f77-b650-9d3d1b817efe response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78272025-01-15T00:52:26.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 58703422-1e7b-4390-8c72-7e9a90db4180 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78282025-01-15T00:52:26.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 58703422-1e7b-4390-8c72-7e9a90db4180 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78292025-01-15T00:52:26.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1806 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 58703422-1e7b-4390-8c72-7e9a90db4180 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78302025-01-15T00:52:27.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 66d04644-6cc0-4b6c-a4ee-3242c1a15106 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78312025-01-15T00:52:27.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 66d04644-6cc0-4b6c-a4ee-3242c1a15106 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78322025-01-15T00:52:27.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2896 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 66d04644-6cc0-4b6c-a4ee-3242c1a15106 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78332025-01-15T00:52:28.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 694f6896-04e5-4f40-a343-4aef5cc4bf70 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78342025-01-15T00:52:28.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 694f6896-04e5-4f40-a343-4aef5cc4bf70 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78352025-01-15T00:52:28.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1824 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 694f6896-04e5-4f40-a343-4aef5cc4bf70 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78362025-01-15T00:52:29.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62291b36-6ae8-417c-94ce-4a24101c17ef roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78372025-01-15T00:52:29.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62291b36-6ae8-417c-94ce-4a24101c17ef resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78382025-01-15T00:52:29.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62291b36-6ae8-417c-94ce-4a24101c17ef response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78392025-01-15T00:52:30.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 206a73fa-85d5-41e8-a5a0-58952f53a5af roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78402025-01-15T00:52:30.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 206a73fa-85d5-41e8-a5a0-58952f53a5af resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78412025-01-15T00:52:30.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 206a73fa-85d5-41e8-a5a0-58952f53a5af response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78422025-01-15T00:52:31.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 04c952ec-c99b-4243-b41f-2542f162c7cc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78432025-01-15T00:52:31.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 04c952ec-c99b-4243-b41f-2542f162c7cc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78442025-01-15T00:52:31.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1567 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 04c952ec-c99b-4243-b41f-2542f162c7cc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78452025-01-15T00:52:32.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4f7cfea-ee8f-4ea2-bdb5-97f3381e3fd7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78462025-01-15T00:52:32.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4f7cfea-ee8f-4ea2-bdb5-97f3381e3fd7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78472025-01-15T00:52:32.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a4f7cfea-ee8f-4ea2-bdb5-97f3381e3fd7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78482025-01-15T00:52:32.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
78492025-01-15T00:52:32.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78502025-01-15T00:52:32.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78512025-01-15T00:52:32.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78522025-01-15T00:52:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78532025-01-15T00:52:32.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78542025-01-15T00:52:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78552025-01-15T00:52:32.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
78562025-01-15T00:52:32.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78572025-01-15T00:52:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78582025-01-15T00:52:32.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78592025-01-15T00:52:32.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78602025-01-15T00:52:32.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78612025-01-15T00:52:32.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78622025-01-15T00:52:32.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78632025-01-15T00:52:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
78642025-01-15T00:52:32.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78652025-01-15T00:52:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78662025-01-15T00:52:32.614ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.76273ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78672025-01-15T00:52:32.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
78682025-01-15T00:52:32.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.652978ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
78692025-01-15T00:52:33.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99b7fa4d-0186-4f92-b1f0-d1ce2349f3bf roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78702025-01-15T00:52:33.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99b7fa4d-0186-4f92-b1f0-d1ce2349f3bf resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78712025-01-15T00:52:33.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7249 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99b7fa4d-0186-4f92-b1f0-d1ce2349f3bf response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78722025-01-15T00:52:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 628 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = ff6b26b9-c3d5-4692-8167-cc5e85fa41a5 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
78732025-01-15T00:52:34.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bcab4bf8-52f8-45dd-80e0-0da359f6de74 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78742025-01-15T00:52:34.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bcab4bf8-52f8-45dd-80e0-0da359f6de74 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78752025-01-15T00:52:34.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bcab4bf8-52f8-45dd-80e0-0da359f6de74 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78762025-01-15T00:52:35.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ba6b5069-1a24-4a25-b0a9-1e9500ae9cc2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78772025-01-15T00:52:35.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ba6b5069-1a24-4a25-b0a9-1e9500ae9cc2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78782025-01-15T00:52:35.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1545 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ba6b5069-1a24-4a25-b0a9-1e9500ae9cc2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78792025-01-15T00:52:36.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c2d82389-3f95-4c6f-87d2-789cdcce26a1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78802025-01-15T00:52:36.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c2d82389-3f95-4c6f-87d2-789cdcce26a1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78812025-01-15T00:52:36.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c2d82389-3f95-4c6f-87d2-789cdcce26a1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78822025-01-15T00:52:37.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab31c414-7536-492c-891c-23accd8a3601 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78832025-01-15T00:52:37.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab31c414-7536-492c-891c-23accd8a3601 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78842025-01-15T00:52:37.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab31c414-7536-492c-891c-23accd8a3601 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78852025-01-15T00:52:38.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a65b5335-f05b-4c91-a839-0811b9743a46 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78862025-01-15T00:52:38.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a65b5335-f05b-4c91-a839-0811b9743a46 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78872025-01-15T00:52:38.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2308 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a65b5335-f05b-4c91-a839-0811b9743a46 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78882025-01-15T00:52:39.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b5a9dd84-f689-407c-a4e4-f81d418a3ca5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78892025-01-15T00:52:39.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b5a9dd84-f689-407c-a4e4-f81d418a3ca5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78902025-01-15T00:52:39.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b5a9dd84-f689-407c-a4e4-f81d418a3ca5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78912025-01-15T00:52:40.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94cb33f7-5140-4d28-814d-0534a6c3a251 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78922025-01-15T00:52:40.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94cb33f7-5140-4d28-814d-0534a6c3a251 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78932025-01-15T00:52:40.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2015 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94cb33f7-5140-4d28-814d-0534a6c3a251 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78942025-01-15T00:52:41.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d68b18c9-3cb7-4fb3-92d5-fd53fb293284 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78952025-01-15T00:52:41.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d68b18c9-3cb7-4fb3-92d5-fd53fb293284 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78962025-01-15T00:52:41.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d68b18c9-3cb7-4fb3-92d5-fd53fb293284 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78972025-01-15T00:52:42.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 269a5a0a-2a63-42c6-91cf-23a0fd752970 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78982025-01-15T00:52:42.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 269a5a0a-2a63-42c6-91cf-23a0fd752970 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
78992025-01-15T00:52:42.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2490 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 269a5a0a-2a63-42c6-91cf-23a0fd752970 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79002025-01-15T00:52:42.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
79012025-01-15T00:52:42.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79022025-01-15T00:52:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79032025-01-15T00:52:42.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79042025-01-15T00:52:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79052025-01-15T00:52:42.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79062025-01-15T00:52:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79072025-01-15T00:52:42.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
79082025-01-15T00:52:42.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79092025-01-15T00:52:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79102025-01-15T00:52:42.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79112025-01-15T00:52:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79122025-01-15T00:52:42.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79132025-01-15T00:52:42.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79142025-01-15T00:52:42.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79152025-01-15T00:52:42.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.557138ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79162025-01-15T00:52:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
79172025-01-15T00:52:42.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79182025-01-15T00:52:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79192025-01-15T00:52:42.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
79202025-01-15T00:52:42.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.084256ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
79212025-01-15T00:52:43.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa9b6136-0894-40fa-88d2-cd32a610b95d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79222025-01-15T00:52:43.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa9b6136-0894-40fa-88d2-cd32a610b95d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79232025-01-15T00:52:43.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa9b6136-0894-40fa-88d2-cd32a610b95d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79242025-01-15T00:52:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 606 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 68aac868-5e7a-46e4-ab65-2a9761a5578d response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
79252025-01-15T00:52:44.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c8dd127d-62af-4cfe-8e56-70632d61e90a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79262025-01-15T00:52:44.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c8dd127d-62af-4cfe-8e56-70632d61e90a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79272025-01-15T00:52:44.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c8dd127d-62af-4cfe-8e56-70632d61e90a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79282025-01-15T00:52:45.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ec36155-1cc8-4dca-8873-ba8aa0f3cb75 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79292025-01-15T00:52:45.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ec36155-1cc8-4dca-8873-ba8aa0f3cb75 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79302025-01-15T00:52:45.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ec36155-1cc8-4dca-8873-ba8aa0f3cb75 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79312025-01-15T00:52:46.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 477b5885-6a41-4402-9c22-8826890d5e2b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79322025-01-15T00:52:46.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 477b5885-6a41-4402-9c22-8826890d5e2b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79332025-01-15T00:52:46.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 477b5885-6a41-4402-9c22-8826890d5e2b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79342025-01-15T00:52:47.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ee85def-a7b4-45ce-a371-265f17625e98 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79352025-01-15T00:52:47.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ee85def-a7b4-45ce-a371-265f17625e98 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79362025-01-15T00:52:47.669ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2368 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ee85def-a7b4-45ce-a371-265f17625e98 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79372025-01-15T00:52:48.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 96c479de-f724-418a-b81c-a62d59585388 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79382025-01-15T00:52:48.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 96c479de-f724-418a-b81c-a62d59585388 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79392025-01-15T00:52:48.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 96c479de-f724-418a-b81c-a62d59585388 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79402025-01-15T00:52:49.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = d0de6ea1-3b03-4da7-a654-b6d268e1de82 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
79412025-01-15T00:52:49.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = d0de6ea1-3b03-4da7-a654-b6d268e1de82 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
79422025-01-15T00:52:49.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3316 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = d0de6ea1-3b03-4da7-a654-b6d268e1de82 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
79432025-01-15T00:52:49.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5f5fcc19-c705-4c78-918c-fc86a9123562 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
79442025-01-15T00:52:49.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5f5fcc19-c705-4c78-918c-fc86a9123562 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
79452025-01-15T00:52:49.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2457 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5f5fcc19-c705-4c78-918c-fc86a9123562 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
79462025-01-15T00:52:49.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4accf83b-d9ba-49d6-9c7a-9d3db661de5b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79472025-01-15T00:52:49.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4accf83b-d9ba-49d6-9c7a-9d3db661de5b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79482025-01-15T00:52:49.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4accf83b-d9ba-49d6-9c7a-9d3db661de5b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79492025-01-15T00:52:50.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9792c00d-c766-46c7-a731-97ff28aeff23 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79502025-01-15T00:52:50.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9792c00d-c766-46c7-a731-97ff28aeff23 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79512025-01-15T00:52:50.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1872 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9792c00d-c766-46c7-a731-97ff28aeff23 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79522025-01-15T00:52:51.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bfa02632-bd59-4525-85c1-20624dbf03e4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79532025-01-15T00:52:51.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bfa02632-bd59-4525-85c1-20624dbf03e4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79542025-01-15T00:52:51.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bfa02632-bd59-4525-85c1-20624dbf03e4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
79552025-01-15T00:52:52.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = fab62efa-60e4-4dfa-8f16-657c5911823b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
79562025-01-15T00:52:52.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = fab62efa-60e4-4dfa-8f16-657c5911823b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
79572025-01-15T00:52:52.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7215 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = fab62efa-60e4-4dfa-8f16-657c5911823b response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
79582025-01-15T00:52:52.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
79592025-01-15T00:52:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
79602025-01-15T00:52:52.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79612025-01-15T00:52:52.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
79622025-01-15T00:52:52.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
79632025-01-15T00:52:52.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.27\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
79642025-01-15T00:52:52.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
79652025-01-15T00:52:52.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
79662025-01-15T00:52:52.602ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:42:52.602942625 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
79672025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
79682025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
79692025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
79702025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
79712025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
79722025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
79732025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79742025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
79752025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
79762025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
79772025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79782025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
79792025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
79802025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
79812025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
79822025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
79832025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79842025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
79852025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
79862025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
79872025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
79882025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79892025-01-15T00:52:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79902025-01-15T00:52:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1392, tv_nsec: 933487036 } })
79912025-01-15T00:52:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1392, tv_nsec: 933484425 } })
79922025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
79932025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.112251ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
79942025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
79952025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.366997ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
79962025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
79972025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
79982025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79992025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80002025-01-15T00:52:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
80012025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
80022025-01-15T00:52:52.605ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
80032025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80042025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80052025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
80062025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80072025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80082025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80092025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80102025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80112025-01-15T00:52:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80122025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80132025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.311903ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80142025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
80152025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
80162025-01-15T00:52:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80172025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
80182025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80192025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80202025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
80212025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80222025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
80232025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80242025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
80252025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80262025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80272025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
80282025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
80292025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80302025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80312025-01-15T00:52:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1392, tv_nsec: 937502033 } })
80322025-01-15T00:52:52.607ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:42:52.602942625 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
80332025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.805313ms iteration = 9 status = {"expiration":"2025-01-15T00:42:52.602942625Z","pruned":[]}
80342025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80352025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80362025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80372025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80382025-01-15T00:52:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
80392025-01-15T00:52:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
80402025-01-15T00:52:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80412025-01-15T00:52:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80422025-01-15T00:52:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80432025-01-15T00:52:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
80442025-01-15T00:52:52.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80452025-01-15T00:52:52.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80462025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
80472025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
80482025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
80492025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80502025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
80512025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80522025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
80532025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
80542025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
80552025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
80562025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
80572025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
80582025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80592025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80602025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
80612025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
80622025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80632025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80642025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
80652025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80662025-01-15T00:52:52.610ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1392, tv_nsec: 940472090 } })
80672025-01-15T00:52:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
80682025-01-15T00:52:52.610ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
80692025-01-15T00:52:52.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80702025-01-15T00:52:52.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80712025-01-15T00:52:52.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80722025-01-15T00:52:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80732025-01-15T00:52:52.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80742025-01-15T00:52:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80752025-01-15T00:52:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80762025-01-15T00:52:52.616ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80772025-01-15T00:52:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80782025-01-15T00:52:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
80792025-01-15T00:52:52.616ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80802025-01-15T00:52:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
80812025-01-15T00:52:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80822025-01-15T00:52:52.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80832025-01-15T00:52:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80842025-01-15T00:52:52.617ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80852025-01-15T00:52:52.618ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80862025-01-15T00:52:52.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80872025-01-15T00:52:52.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80882025-01-15T00:52:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
80892025-01-15T00:52:52.620ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80902025-01-15T00:52:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80912025-01-15T00:52:52.622ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80922025-01-15T00:52:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80932025-01-15T00:52:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80942025-01-15T00:52:52.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80952025-01-15T00:52:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80962025-01-15T00:52:52.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80972025-01-15T00:52:52.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80982025-01-15T00:52:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
80992025-01-15T00:52:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81002025-01-15T00:52:52.624ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
81012025-01-15T00:52:52.624ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
81022025-01-15T00:52:52.624ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
81032025-01-15T00:52:52.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81042025-01-15T00:52:52.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81052025-01-15T00:52:52.626ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81062025-01-15T00:52:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
81072025-01-15T00:52:52.629ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81082025-01-15T00:52:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81092025-01-15T00:52:52.630ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.26841ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
81102025-01-15T00:52:52.630ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81112025-01-15T00:52:52.633ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81122025-01-15T00:52:52.633ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81132025-01-15T00:52:52.633ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81142025-01-15T00:52:52.633ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81152025-01-15T00:52:52.633ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.34966ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
81162025-01-15T00:52:52.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81172025-01-15T00:52:52.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81182025-01-15T00:52:52.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81192025-01-15T00:52:52.634ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
81202025-01-15T00:52:52.634ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
81212025-01-15T00:52:52.634ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 24.399099ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
81222025-01-15T00:52:52.636ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 26.545611ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
81232025-01-15T00:52:52.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81242025-01-15T00:52:52.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81252025-01-15T00:52:52.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81262025-01-15T00:52:52.643ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81272025-01-15T00:52:52.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81282025-01-15T00:52:52.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81292025-01-15T00:52:52.644ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1392, tv_nsec: 974447904 } })
81302025-01-15T00:52:52.644ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
81312025-01-15T00:52:52.645ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81322025-01-15T00:52:52.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81332025-01-15T00:52:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81342025-01-15T00:52:52.646ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81352025-01-15T00:52:52.647ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81362025-01-15T00:52:52.647ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
81372025-01-15T00:52:52.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81382025-01-15T00:52:52.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81392025-01-15T00:52:52.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81402025-01-15T00:52:52.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81412025-01-15T00:52:52.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81422025-01-15T00:52:52.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
81432025-01-15T00:52:52.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81442025-01-15T00:52:52.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81452025-01-15T00:52:52.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81462025-01-15T00:52:52.655ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
81472025-01-15T00:52:52.655ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.3139ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
81482025-01-15T00:52:52.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
81492025-01-15T00:52:52.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81502025-01-15T00:52:52.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81512025-01-15T00:52:52.682ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
81522025-01-15T00:52:52.682ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.125673ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
81532025-01-15T00:52:52.684ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81542025-01-15T00:52:52.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81552025-01-15T00:52:52.685ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81562025-01-15T00:52:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81572025-01-15T00:52:52.688ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
81582025-01-15T00:52:52.688ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
81592025-01-15T00:52:52.688ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
81602025-01-15T00:52:52.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81612025-01-15T00:52:52.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81622025-01-15T00:52:52.688ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81632025-01-15T00:52:52.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81642025-01-15T00:52:52.690ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81652025-01-15T00:52:52.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81662025-01-15T00:52:52.692ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81672025-01-15T00:52:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81682025-01-15T00:52:52.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.170528ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81692025-01-15T00:52:52.695ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
81702025-01-15T00:52:52.695ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81712025-01-15T00:52:52.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81722025-01-15T00:52:52.696ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81732025-01-15T00:52:52.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81742025-01-15T00:52:52.697ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
81752025-01-15T00:52:52.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81762025-01-15T00:52:52.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81772025-01-15T00:52:52.701ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81782025-01-15T00:52:52.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81792025-01-15T00:52:52.702ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
81802025-01-15T00:52:52.702ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
81812025-01-15T00:52:52.702ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.605208ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
81822025-01-15T00:52:52.702ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.779542ms iteration = 17 status = 0
81832025-01-15T00:52:52.704ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81842025-01-15T00:52:52.704ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81852025-01-15T00:52:52.704ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.942816ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81862025-01-15T00:52:52.705ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81872025-01-15T00:52:52.707ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81882025-01-15T00:52:52.708ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
81892025-01-15T00:52:52.708ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81902025-01-15T00:52:52.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81912025-01-15T00:52:52.710ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81922025-01-15T00:52:52.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
81932025-01-15T00:52:52.712ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81942025-01-15T00:52:52.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81952025-01-15T00:52:52.714ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81962025-01-15T00:52:52.714ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81972025-01-15T00:52:52.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81982025-01-15T00:52:52.714ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
81992025-01-15T00:52:52.714ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
82002025-01-15T00:52:52.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82012025-01-15T00:52:52.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82022025-01-15T00:52:52.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82032025-01-15T00:52:52.724ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82042025-01-15T00:52:52.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82052025-01-15T00:52:52.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82062025-01-15T00:52:52.733ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 125.873052ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82072025-01-15T00:52:52.735ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
82082025-01-15T00:52:52.735ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
82092025-01-15T00:52:52.735ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
82102025-01-15T00:52:52.735ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 132.530121ms iteration = 9 status = {"generation":1}
82112025-01-15T00:52:52.744ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82122025-01-15T00:52:52.744ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
82132025-01-15T00:52:52.744ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
82142025-01-15T00:52:52.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82152025-01-15T00:52:52.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82162025-01-15T00:52:52.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82172025-01-15T00:52:52.746ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82182025-01-15T00:52:52.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82192025-01-15T00:52:52.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82202025-01-15T00:52:52.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82212025-01-15T00:52:52.752ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82222025-01-15T00:52:52.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82232025-01-15T00:52:52.756ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
82242025-01-15T00:52:52.756ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 151.2566ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
82252025-01-15T00:52:52.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 150.008837ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82262025-01-15T00:52:52.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
82272025-01-15T00:52:52.761ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82282025-01-15T00:52:52.761ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "faf66372-3028-47ef-a8fc-1a1c6017c2b5", "content-length": "26", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
82292025-01-15T00:52:52.761ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82302025-01-15T00:52:52.763ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
82312025-01-15T00:52:52.763ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
82322025-01-15T00:52:52.763ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
82332025-01-15T00:52:52.763ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 160.746403ms iteration = 9 status = {"generation":2}
82342025-01-15T00:52:52.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82352025-01-15T00:52:52.770ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82362025-01-15T00:52:52.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82372025-01-15T00:52:52.772ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82382025-01-15T00:52:52.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82392025-01-15T00:52:52.774ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82402025-01-15T00:52:52.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82412025-01-15T00:52:52.777ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 172.269876ms iteration = 19 status = {"physical_disks_added":0}
82422025-01-15T00:52:52.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 191.977524ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
82432025-01-15T00:52:52.816ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
82442025-01-15T00:52:52.816ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82452025-01-15T00:52:52.817ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ac3a7e9-78d3-4f86-8cb5-7252c0753e78", "content-length": "26", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
82462025-01-15T00:52:52.817ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82472025-01-15T00:52:52.820ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82482025-01-15T00:52:52.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82492025-01-15T00:52:52.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82502025-01-15T00:52:52.841ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
82512025-01-15T00:52:52.849ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
82522025-01-15T00:52:52.872ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
82532025-01-15T00:52:52.872ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82542025-01-15T00:52:52.872ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "209169ed-6461-4a3f-b7a5-a644e4d9882f", "content-length": "26", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
82552025-01-15T00:52:52.872ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82562025-01-15T00:52:52.873ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
82572025-01-15T00:52:52.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 266.157452ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
82582025-01-15T00:52:52.874ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
82592025-01-15T00:52:52.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fb61dc96-892d-47ba-91b3-e1e4904712fb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
82602025-01-15T00:52:52.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fb61dc96-892d-47ba-91b3-e1e4904712fb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
82612025-01-15T00:52:52.946ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 343.894838ms iteration = 17 status = {}
82622025-01-15T00:52:52.963ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82632025-01-15T00:52:52.963ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82642025-01-15T00:52:52.963ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f51bd754-343a-415c-8ebd-37a605779f05", "content-length": "372", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
82652025-01-15T00:52:52.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82662025-01-15T00:52:52.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82672025-01-15T00:52:52.965ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82682025-01-15T00:52:52.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77605 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fb61dc96-892d-47ba-91b3-e1e4904712fb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
82692025-01-15T00:52:52.968ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82702025-01-15T00:52:52.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82712025-01-15T00:52:52.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82722025-01-15T00:52:52.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82732025-01-15T00:52:52.973ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
82742025-01-15T00:52:52.973ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82752025-01-15T00:52:52.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82762025-01-15T00:52:52.974ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
82772025-01-15T00:52:52.974ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab10a3e1-9429-41c7-b7e4-19d85ead4bf9", "content-length": "1", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
82782025-01-15T00:52:52.976ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82792025-01-15T00:52:52.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82802025-01-15T00:52:52.979ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 376.344563ms iteration = 17 status = null
82812025-01-15T00:52:53.006ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
82822025-01-15T00:52:53.006ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 403.528216ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
82832025-01-15T00:52:53.023ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
82842025-01-15T00:52:53.023ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
82852025-01-15T00:52:53.023ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bfd282e3-1e7c-41e1-a962-6d835ed16c8e", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
82862025-01-15T00:52:53.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82872025-01-15T00:52:53.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82882025-01-15T00:52:53.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82892025-01-15T00:52:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82902025-01-15T00:52:53.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82912025-01-15T00:52:53.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82922025-01-15T00:52:53.032ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
82932025-01-15T00:52:53.032ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82942025-01-15T00:52:53.032ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bfc889e0-91cb-4d50-8418-7a32bdfe0931", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
82952025-01-15T00:52:53.034ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 427.388535ms iteration = 17 status = {}
82962025-01-15T00:52:53.090ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
82972025-01-15T00:52:53.098ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
82982025-01-15T00:52:53.099ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
82992025-01-15T00:52:53.099ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "96b9cb7f-d51e-4612-8628-c9d89dc42f3a", "content-length": "691", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
83002025-01-15T00:52:53.099ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
83012025-01-15T00:52:53.099ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
83022025-01-15T00:52:53.099ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
83032025-01-15T00:52:53.099ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e7648d62-2c6b-453e-8109-d6540d92c791", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83042025-01-15T00:52:53.099ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83052025-01-15T00:52:53.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 494.416835ms iteration = 17 status = {}
83062025-01-15T00:52:53.102ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2ebc589c-5be8-47f4-a77b-ddf265cd4bb9", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83072025-01-15T00:52:53.102ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83082025-01-15T00:52:53.104ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83092025-01-15T00:52:53.104ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 501.203836ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
83102025-01-15T00:52:53.137ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
83112025-01-15T00:52:53.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "87f7f775-0a8b-4c0f-be94-3ee42736668d", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
83122025-01-15T00:52:53.138ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
83132025-01-15T00:52:53.138ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1ff2284b-da7f-4b74-9407-bafddb46fd42", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
83142025-01-15T00:52:53.138ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
83152025-01-15T00:52:53.140ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5091f6ab-5367-4978-862a-4a4ce6f8842e", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
83162025-01-15T00:52:53.140ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
83172025-01-15T00:52:53.142ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
83182025-01-15T00:52:53.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 539.186057ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
83192025-01-15T00:52:53.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83202025-01-15T00:52:53.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83212025-01-15T00:52:53.154ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
83222025-01-15T00:52:53.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83232025-01-15T00:52:53.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83242025-01-15T00:52:53.165ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
83252025-01-15T00:52:53.165ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7575c4d-f039-4ba9-aede-01bf74040c20", "content-length": "134", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
83262025-01-15T00:52:53.165ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
83272025-01-15T00:52:53.165ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
83282025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
83292025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
83302025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83312025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83322025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83332025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83342025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
83352025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
83362025-01-15T00:52:53.166ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
83372025-01-15T00:52:53.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83382025-01-15T00:52:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83392025-01-15T00:52:53.169ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
83402025-01-15T00:52:53.169ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea473704-be92-46a2-b984-6c44d2fb5006", "content-length": "2", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
83412025-01-15T00:52:53.169ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
83422025-01-15T00:52:53.169ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "499cb4cc-c590-466c-9eda-07450e9081c9", "content-length": "51", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
83432025-01-15T00:52:53.169ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
83442025-01-15T00:52:53.169ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
83452025-01-15T00:52:53.265ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d6e20001-10f1-4a2a-ba65-1537168e3fd7", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
83462025-01-15T00:52:53.265ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
83472025-01-15T00:52:53.265ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
83482025-01-15T00:52:53.265ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "06b839c6-e4b6-49d0-8ea1-96a95a1064d8", "content-length": "682", "date": "Wed, 15 Jan 2025 00:52:52 GMT"} })
83492025-01-15T00:52:53.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83502025-01-15T00:52:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83512025-01-15T00:52:53.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83522025-01-15T00:52:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83532025-01-15T00:52:53.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83542025-01-15T00:52:53.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83552025-01-15T00:52:53.273ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83562025-01-15T00:52:53.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83572025-01-15T00:52:53.280ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 675.881537ms iteration = 17 status = {}
83582025-01-15T00:52:53.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b676fbb-7201-4524-a22e-d1e94aa83b5f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83592025-01-15T00:52:53.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b676fbb-7201-4524-a22e-d1e94aa83b5f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83602025-01-15T00:52:53.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b676fbb-7201-4524-a22e-d1e94aa83b5f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83612025-01-15T00:52:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = ebeddf75-25a1-4ee3-b040-6aab5b7d1394 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
83622025-01-15T00:52:55.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b7198c5-9630-47b4-93fd-3c95b2d74507 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83632025-01-15T00:52:55.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b7198c5-9630-47b4-93fd-3c95b2d74507 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83642025-01-15T00:52:55.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b7198c5-9630-47b4-93fd-3c95b2d74507 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83652025-01-15T00:52:56.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5dc24a98-bd06-48b0-9e57-19c08b07759e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83662025-01-15T00:52:56.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5dc24a98-bd06-48b0-9e57-19c08b07759e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83672025-01-15T00:52:56.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5dc24a98-bd06-48b0-9e57-19c08b07759e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83682025-01-15T00:52:57.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e85ca7af-f24c-44dd-915a-5e52d2749ea3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83692025-01-15T00:52:57.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e85ca7af-f24c-44dd-915a-5e52d2749ea3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83702025-01-15T00:52:57.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e85ca7af-f24c-44dd-915a-5e52d2749ea3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83712025-01-15T00:52:58.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4712f91c-6234-4859-8ff3-f42e06234c5e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83722025-01-15T00:52:58.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4712f91c-6234-4859-8ff3-f42e06234c5e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83732025-01-15T00:52:58.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2614 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4712f91c-6234-4859-8ff3-f42e06234c5e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83742025-01-15T00:52:59.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 26277042-92f4-4565-b7d8-8679a07a6db1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83752025-01-15T00:52:59.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 26277042-92f4-4565-b7d8-8679a07a6db1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83762025-01-15T00:52:59.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 26277042-92f4-4565-b7d8-8679a07a6db1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83772025-01-15T00:53:00.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6a339bc0-c8f5-48e4-bb9c-e458193962bf roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83782025-01-15T00:53:00.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6a339bc0-c8f5-48e4-bb9c-e458193962bf resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83792025-01-15T00:53:00.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1975 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6a339bc0-c8f5-48e4-bb9c-e458193962bf response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83802025-01-15T00:53:01.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d49d431c-5ffd-4f7d-8adb-e4fc00a2d772 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83812025-01-15T00:53:01.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d49d431c-5ffd-4f7d-8adb-e4fc00a2d772 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83822025-01-15T00:53:01.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d49d431c-5ffd-4f7d-8adb-e4fc00a2d772 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83832025-01-15T00:53:02.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6d4fd8a6-4bbf-46ee-9d77-949d7989ae71 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83842025-01-15T00:53:02.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6d4fd8a6-4bbf-46ee-9d77-949d7989ae71 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83852025-01-15T00:53:02.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1637 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6d4fd8a6-4bbf-46ee-9d77-949d7989ae71 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
83862025-01-15T00:53:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
83872025-01-15T00:53:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83882025-01-15T00:53:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83892025-01-15T00:53:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83902025-01-15T00:53:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83912025-01-15T00:53:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83922025-01-15T00:53:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83932025-01-15T00:53:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
83942025-01-15T00:53:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83952025-01-15T00:53:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83962025-01-15T00:53:02.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83972025-01-15T00:53:02.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83982025-01-15T00:53:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83992025-01-15T00:53:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84002025-01-15T00:53:02.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.823854ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84012025-01-15T00:53:02.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84022025-01-15T00:53:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
84032025-01-15T00:53:02.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84042025-01-15T00:53:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84052025-01-15T00:53:02.627ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
84062025-01-15T00:53:02.627ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.838349ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
84072025-01-15T00:53:03.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fafb3eea-645d-4a20-8efc-e08947b674c5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84082025-01-15T00:53:03.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fafb3eea-645d-4a20-8efc-e08947b674c5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84092025-01-15T00:53:03.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fafb3eea-645d-4a20-8efc-e08947b674c5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84102025-01-15T00:53:04.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fab8b19c-fb59-4c6b-9a72-e80a3a1dfb9e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84112025-01-15T00:53:04.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fab8b19c-fb59-4c6b-9a72-e80a3a1dfb9e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84122025-01-15T00:53:04.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fab8b19c-fb59-4c6b-9a72-e80a3a1dfb9e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84132025-01-15T00:53:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 501 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 12ddc4ae-e42c-49e8-8251-5fbf22d27f38 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
84142025-01-15T00:53:05.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 97a62582-4f99-4d80-a37d-0a3e1429ef17 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84152025-01-15T00:53:05.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 97a62582-4f99-4d80-a37d-0a3e1429ef17 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84162025-01-15T00:53:05.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 97a62582-4f99-4d80-a37d-0a3e1429ef17 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84172025-01-15T00:53:06.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f12d60b6-6d4b-427e-b7c0-a8ba2cd7093f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84182025-01-15T00:53:06.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f12d60b6-6d4b-427e-b7c0-a8ba2cd7093f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84192025-01-15T00:53:06.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f12d60b6-6d4b-427e-b7c0-a8ba2cd7093f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84202025-01-15T00:53:07.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a365fb70-9926-41b6-ab19-3301d342aa38 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84212025-01-15T00:53:07.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a365fb70-9926-41b6-ab19-3301d342aa38 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84222025-01-15T00:53:07.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2344 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a365fb70-9926-41b6-ab19-3301d342aa38 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84232025-01-15T00:53:08.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 920abddc-db6a-4fdd-a736-f2c2161e9cf5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84242025-01-15T00:53:08.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 920abddc-db6a-4fdd-a736-f2c2161e9cf5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84252025-01-15T00:53:08.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 920abddc-db6a-4fdd-a736-f2c2161e9cf5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84262025-01-15T00:53:09.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 23157737-9d75-4b07-825c-e9cf587cdea6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84272025-01-15T00:53:09.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 23157737-9d75-4b07-825c-e9cf587cdea6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84282025-01-15T00:53:09.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 23157737-9d75-4b07-825c-e9cf587cdea6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84292025-01-15T00:53:10.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5c8481fe-787d-46bd-9ee7-3c13720af1b9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84302025-01-15T00:53:10.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5c8481fe-787d-46bd-9ee7-3c13720af1b9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84312025-01-15T00:53:10.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2145 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5c8481fe-787d-46bd-9ee7-3c13720af1b9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84322025-01-15T00:53:11.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7f7efd67-9f1f-463b-9ed2-881155f2094b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84332025-01-15T00:53:11.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7f7efd67-9f1f-463b-9ed2-881155f2094b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84342025-01-15T00:53:11.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7f7efd67-9f1f-463b-9ed2-881155f2094b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84352025-01-15T00:53:12.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 75cd7cad-fd00-403f-aed2-34ff5bb5bfc7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84362025-01-15T00:53:12.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 75cd7cad-fd00-403f-aed2-34ff5bb5bfc7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84372025-01-15T00:53:12.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 75cd7cad-fd00-403f-aed2-34ff5bb5bfc7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84382025-01-15T00:53:12.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
84392025-01-15T00:53:12.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84402025-01-15T00:53:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84412025-01-15T00:53:12.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84422025-01-15T00:53:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84432025-01-15T00:53:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84442025-01-15T00:53:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84452025-01-15T00:53:12.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
84462025-01-15T00:53:12.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84472025-01-15T00:53:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84482025-01-15T00:53:12.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84492025-01-15T00:53:12.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84502025-01-15T00:53:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84512025-01-15T00:53:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84522025-01-15T00:53:12.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84532025-01-15T00:53:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
84542025-01-15T00:53:12.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84552025-01-15T00:53:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84562025-01-15T00:53:12.626ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
84572025-01-15T00:53:12.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.011073ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
84582025-01-15T00:53:12.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.891304ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84592025-01-15T00:53:13.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b92a641-ccd2-4358-a29b-6dfb2e94e5ff roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84602025-01-15T00:53:13.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b92a641-ccd2-4358-a29b-6dfb2e94e5ff resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84612025-01-15T00:53:13.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b92a641-ccd2-4358-a29b-6dfb2e94e5ff response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84622025-01-15T00:53:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 59fef10f-a501-4221-9ffd-dcbaca55aaf7 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
84632025-01-15T00:53:14.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2ddb467-c6df-42e1-8ea6-77066b6a21a1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84642025-01-15T00:53:14.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2ddb467-c6df-42e1-8ea6-77066b6a21a1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84652025-01-15T00:53:14.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2563 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a2ddb467-c6df-42e1-8ea6-77066b6a21a1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84662025-01-15T00:53:15.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eee555c1-6fc4-4d30-a6a8-f74057cd91ac roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84672025-01-15T00:53:15.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eee555c1-6fc4-4d30-a6a8-f74057cd91ac resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84682025-01-15T00:53:15.451ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eee555c1-6fc4-4d30-a6a8-f74057cd91ac response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84692025-01-15T00:53:16.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99d63cf6-b4d2-442e-b721-00bad016177a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84702025-01-15T00:53:16.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99d63cf6-b4d2-442e-b721-00bad016177a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84712025-01-15T00:53:16.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99d63cf6-b4d2-442e-b721-00bad016177a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84722025-01-15T00:53:17.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7edb5a32-dba4-40e0-993a-f469df567ec6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84732025-01-15T00:53:17.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7edb5a32-dba4-40e0-993a-f469df567ec6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84742025-01-15T00:53:17.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7edb5a32-dba4-40e0-993a-f469df567ec6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84752025-01-15T00:53:18.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdfc0750-26ed-482b-91a8-73e9a8e6a096 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84762025-01-15T00:53:18.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdfc0750-26ed-482b-91a8-73e9a8e6a096 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84772025-01-15T00:53:18.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fdfc0750-26ed-482b-91a8-73e9a8e6a096 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84782025-01-15T00:53:19.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 69ef3eff-df8f-422f-b730-cac065fee1e6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84792025-01-15T00:53:19.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 69ef3eff-df8f-422f-b730-cac065fee1e6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84802025-01-15T00:53:19.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 69ef3eff-df8f-422f-b730-cac065fee1e6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84812025-01-15T00:53:20.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f0d73c93-61bb-48ad-bf7d-ef3c2dfd6c13 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84822025-01-15T00:53:20.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f0d73c93-61bb-48ad-bf7d-ef3c2dfd6c13 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84832025-01-15T00:53:20.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1849 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f0d73c93-61bb-48ad-bf7d-ef3c2dfd6c13 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84842025-01-15T00:53:21.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4bde9d6a-cf92-48dc-89a1-89dfe73de28c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84852025-01-15T00:53:21.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4bde9d6a-cf92-48dc-89a1-89dfe73de28c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84862025-01-15T00:53:21.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1901 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4bde9d6a-cf92-48dc-89a1-89dfe73de28c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84872025-01-15T00:53:22.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a8e2de00-fa0b-42e3-8163-78df6c2e5000 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84882025-01-15T00:53:22.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a8e2de00-fa0b-42e3-8163-78df6c2e5000 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84892025-01-15T00:53:22.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a8e2de00-fa0b-42e3-8163-78df6c2e5000 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
84902025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
84912025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
84922025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84932025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
84942025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84952025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
84962025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
84972025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84982025-01-15T00:53:22.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84992025-01-15T00:53:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85002025-01-15T00:53:22.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8546b0e5-2135-4316-b8ee-d0f953ed131d roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
85012025-01-15T00:53:22.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8546b0e5-2135-4316-b8ee-d0f953ed131d resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
85022025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
85032025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
85042025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
85052025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
85062025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85072025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85082025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
85092025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85102025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85112025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85122025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85132025-01-15T00:53:22.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85142025-01-15T00:53:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1422, tv_nsec: 935487824 } })
85152025-01-15T00:53:22.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85162025-01-15T00:53:22.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
85172025-01-15T00:53:22.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.554958ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85182025-01-15T00:53:22.606ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85192025-01-15T00:53:22.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1422, tv_nsec: 936887791 } })
85202025-01-15T00:53:22.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
85212025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
85222025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85232025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
85242025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85252025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85262025-01-15T00:53:22.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3506 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8546b0e5-2135-4316-b8ee-d0f953ed131d response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
85272025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
85282025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
85292025-01-15T00:53:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85302025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85312025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85322025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
85332025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
85342025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85352025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85362025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85372025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85382025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85392025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85402025-01-15T00:53:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85412025-01-15T00:53:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85422025-01-15T00:53:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85432025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85442025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85452025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85462025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
85472025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
85482025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85492025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85502025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
85512025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85522025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
85532025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85542025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85552025-01-15T00:53:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85562025-01-15T00:53:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85572025-01-15T00:53:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85582025-01-15T00:53:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85592025-01-15T00:53:22.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85602025-01-15T00:53:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85612025-01-15T00:53:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
85622025-01-15T00:53:22.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
85632025-01-15T00:53:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85642025-01-15T00:53:22.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85652025-01-15T00:53:22.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85662025-01-15T00:53:22.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85672025-01-15T00:53:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85682025-01-15T00:53:22.612ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85692025-01-15T00:53:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85702025-01-15T00:53:22.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85712025-01-15T00:53:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85722025-01-15T00:53:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
85732025-01-15T00:53:22.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85742025-01-15T00:53:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
85752025-01-15T00:53:22.614ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85762025-01-15T00:53:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85772025-01-15T00:53:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85782025-01-15T00:53:22.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85792025-01-15T00:53:22.617ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85802025-01-15T00:53:22.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85812025-01-15T00:53:22.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85822025-01-15T00:53:22.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85832025-01-15T00:53:22.617ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85842025-01-15T00:53:22.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85852025-01-15T00:53:22.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85862025-01-15T00:53:22.618ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.997253ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
85872025-01-15T00:53:22.620ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85882025-01-15T00:53:22.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85892025-01-15T00:53:22.621ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.121402ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85902025-01-15T00:53:22.621ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85912025-01-15T00:53:22.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85922025-01-15T00:53:22.622ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1422, tv_nsec: 952263187 } })
85932025-01-15T00:53:22.622ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
85942025-01-15T00:53:22.622ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85952025-01-15T00:53:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85962025-01-15T00:53:22.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85972025-01-15T00:53:22.623ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85982025-01-15T00:53:22.623ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85992025-01-15T00:53:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86002025-01-15T00:53:22.624ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 16.812033ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86012025-01-15T00:53:22.626ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86022025-01-15T00:53:22.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86032025-01-15T00:53:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86042025-01-15T00:53:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
86052025-01-15T00:53:22.626ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86062025-01-15T00:53:22.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86072025-01-15T00:53:22.628ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86082025-01-15T00:53:22.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86092025-01-15T00:53:22.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86102025-01-15T00:53:22.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86112025-01-15T00:53:22.639ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
86122025-01-15T00:53:22.639ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.833699ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
86132025-01-15T00:53:22.641ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86142025-01-15T00:53:22.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86152025-01-15T00:53:22.642ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86162025-01-15T00:53:22.642ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
86172025-01-15T00:53:22.642ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86182025-01-15T00:53:22.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86192025-01-15T00:53:22.643ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86202025-01-15T00:53:22.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86212025-01-15T00:53:22.644ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86222025-01-15T00:53:22.647ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86232025-01-15T00:53:22.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
86242025-01-15T00:53:22.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86252025-01-15T00:53:22.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86262025-01-15T00:53:22.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86272025-01-15T00:53:22.649ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 44.6747ms iteration = 18 status = 0
86282025-01-15T00:53:22.649ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.541731ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
86292025-01-15T00:53:22.649ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86302025-01-15T00:53:22.651ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
86312025-01-15T00:53:22.651ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86322025-01-15T00:53:22.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86332025-01-15T00:53:22.653ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
86342025-01-15T00:53:22.653ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 48.744278ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
86352025-01-15T00:53:22.656ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 46.856312ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
86362025-01-15T00:53:22.661ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86372025-01-15T00:53:22.661ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.687004ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86382025-01-15T00:53:22.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86392025-01-15T00:53:22.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86402025-01-15T00:53:22.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 53.602661ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86412025-01-15T00:53:22.678ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86422025-01-15T00:53:22.678ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86432025-01-15T00:53:22.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86442025-01-15T00:53:22.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86452025-01-15T00:53:22.681ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86462025-01-15T00:53:22.681ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86472025-01-15T00:53:22.681ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 73.555956ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86482025-01-15T00:53:22.685ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
86492025-01-15T00:53:22.685ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86502025-01-15T00:53:22.685ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "929592d3-a1cc-4034-8478-1c154803abd0", "content-length": "26", "date": "Wed, 15 Jan 2025 00:53:21 GMT"} })
86512025-01-15T00:53:22.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86522025-01-15T00:53:22.686ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86532025-01-15T00:53:22.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86542025-01-15T00:53:22.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86552025-01-15T00:53:22.731ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 126.617537ms iteration = 20 status = {"physical_disks_added":0}
86562025-01-15T00:53:22.761ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
86572025-01-15T00:53:22.761ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86582025-01-15T00:53:22.761ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ef35975-58a0-4b36-9a4a-168b9985e2b5", "content-length": "26", "date": "Wed, 15 Jan 2025 00:53:21 GMT"} })
86592025-01-15T00:53:22.761ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86602025-01-15T00:53:22.762ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86612025-01-15T00:53:22.789ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86622025-01-15T00:53:22.789ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c364456-0fda-4cf0-ad1f-3ae612e189ad", "content-length": "1", "date": "Wed, 15 Jan 2025 00:53:22 GMT"} })
86632025-01-15T00:53:22.790ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86642025-01-15T00:53:22.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86652025-01-15T00:53:22.802ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
86662025-01-15T00:53:22.802ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86672025-01-15T00:53:22.803ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e729cab2-cf7b-45f0-8652-f062b0f29255", "content-length": "26", "date": "Wed, 15 Jan 2025 00:53:21 GMT"} })
86682025-01-15T00:53:22.803ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86692025-01-15T00:53:22.805ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
86702025-01-15T00:53:22.861ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86712025-01-15T00:53:22.861ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86722025-01-15T00:53:22.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "98c9a926-6b6e-4770-ad36-77b7a93cdb32", "content-length": "372", "date": "Wed, 15 Jan 2025 00:53:22 GMT"} })
86732025-01-15T00:53:22.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86742025-01-15T00:53:22.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86752025-01-15T00:53:22.864ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 262.066053ms iteration = 18 status = null
86762025-01-15T00:53:22.877ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
86772025-01-15T00:53:22.877ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86782025-01-15T00:53:22.877ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "aa820069-024f-4252-8685-826c11931160", "date": "Wed, 15 Jan 2025 00:53:22 GMT"} })
86792025-01-15T00:53:22.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86802025-01-15T00:53:22.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86812025-01-15T00:53:22.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86822025-01-15T00:53:22.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86832025-01-15T00:53:22.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86842025-01-15T00:53:22.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86852025-01-15T00:53:22.886ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
86862025-01-15T00:53:22.886ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86872025-01-15T00:53:22.886ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e758406b-7a94-44c7-b5bd-4d436a16c8b9", "date": "Wed, 15 Jan 2025 00:53:22 GMT"} })
86882025-01-15T00:53:22.888ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 280.698342ms iteration = 18 status = {}
86892025-01-15T00:53:22.894ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 291.982099ms iteration = 18 status = {}
86902025-01-15T00:53:22.927ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86912025-01-15T00:53:22.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86922025-01-15T00:53:22.929ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86932025-01-15T00:53:22.931ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86942025-01-15T00:53:22.931ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86952025-01-15T00:53:22.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86962025-01-15T00:53:22.933ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86972025-01-15T00:53:22.935ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
86982025-01-15T00:53:22.935ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86992025-01-15T00:53:22.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87002025-01-15T00:53:22.961ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87012025-01-15T00:53:22.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87022025-01-15T00:53:22.963ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
87032025-01-15T00:53:22.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87042025-01-15T00:53:22.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87052025-01-15T00:53:22.973ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87062025-01-15T00:53:22.973ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb30310b-5125-4382-b593-30024d349772", "content-length": "134", "date": "Wed, 15 Jan 2025 00:53:22 GMT"} })
87072025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87082025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
87092025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87102025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87112025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87122025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87132025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87142025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87152025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87162025-01-15T00:53:22.973ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87172025-01-15T00:53:22.974ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
87182025-01-15T00:53:22.974ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87192025-01-15T00:53:22.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87202025-01-15T00:53:22.975ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87212025-01-15T00:53:22.975ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "54bfd113-7a6f-4d49-8009-9823f0878008", "content-length": "2", "date": "Wed, 15 Jan 2025 00:53:22 GMT"} })
87222025-01-15T00:53:22.975ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87232025-01-15T00:53:22.975ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0790631-148f-432e-ae60-bd449137154a", "content-length": "51", "date": "Wed, 15 Jan 2025 00:53:22 GMT"} })
87242025-01-15T00:53:22.975ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
87252025-01-15T00:53:22.975ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87262025-01-15T00:53:22.980ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87272025-01-15T00:53:23.070ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "572d9974-e899-41bd-b617-5147026bdbb9", "date": "Wed, 15 Jan 2025 00:53:23 GMT"} })
87282025-01-15T00:53:23.071ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
87292025-01-15T00:53:23.071ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87302025-01-15T00:53:23.071ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "72c04f08-24ee-49e3-92ca-7579ce5db3a6", "content-length": "691", "date": "Wed, 15 Jan 2025 00:53:23 GMT"} })
87312025-01-15T00:53:23.071ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87322025-01-15T00:53:23.071ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87332025-01-15T00:53:23.071ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87342025-01-15T00:53:23.071ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "65a5be47-e270-41fc-87c5-8ed5a7ce6ca9", "content-length": "682", "date": "Wed, 15 Jan 2025 00:53:22 GMT"} })
87352025-01-15T00:53:23.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87362025-01-15T00:53:23.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87372025-01-15T00:53:23.072ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 464.784645ms iteration = 18 status = {}
87382025-01-15T00:53:23.075ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87392025-01-15T00:53:23.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87402025-01-15T00:53:23.079ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87412025-01-15T00:53:23.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87422025-01-15T00:53:23.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87432025-01-15T00:53:23.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87442025-01-15T00:53:23.088ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 484.342052ms iteration = 18 status = {}
87452025-01-15T00:53:23.313ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
87462025-01-15T00:53:23.313ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
87472025-01-15T00:53:23.343ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
87482025-01-15T00:53:23.343ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:33548
87492025-01-15T00:53:23.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:33548 req_id = 13f69d5c-9707-41d4-89cd-6b714ce9cfc2 roles = RoleSet { roles: {} } uri = /metrics/producers
87502025-01-15T00:53:23.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:33548 req_id = 13f69d5c-9707-41d4-89cd-6b714ce9cfc2 resource = Database result = Ok(()) uri = /metrics/producers
87512025-01-15T00:53:23.384ZINFOnexus: assigned collector to new producer collector_id = dee7453b-558a-4d94-b6a0-8b27cb27f002 file = nexus/src/app/oximeter.rs:76 producer_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
87522025-01-15T00:53:23.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40478 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:33548 req_id = 13f69d5c-9707-41d4-89cd-6b714ce9cfc2 response_code = 201 uri = /metrics/producers
87532025-01-15T00:53:23.384ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "13f69d5c-9707-41d4-89cd-6b714ce9cfc2", "content-length": "41", "date": "Wed, 15 Jan 2025 00:53:23 GMT"} })
87542025-01-15T00:53:23.385ZDEBGnexus (producer-registration-task): registered with nexus successfully
87552025-01-15T00:53:23.385ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
87562025-01-15T00:53:23.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e2c3e9e1-be23-4538-9861-33d1ba5405ed roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87572025-01-15T00:53:23.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e2c3e9e1-be23-4538-9861-33d1ba5405ed resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87582025-01-15T00:53:23.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1580 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e2c3e9e1-be23-4538-9861-33d1ba5405ed response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87592025-01-15T00:53:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 512 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 19315993-0031-4304-92f6-18160b142324 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
87602025-01-15T00:53:24.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f8be878-54d2-46ba-aed4-333f2e9cadb6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87612025-01-15T00:53:24.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f8be878-54d2-46ba-aed4-333f2e9cadb6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87622025-01-15T00:53:24.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2009 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f8be878-54d2-46ba-aed4-333f2e9cadb6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87632025-01-15T00:53:25.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2001030d-dfbd-4b31-9ee7-231a59ae71ad roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87642025-01-15T00:53:25.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2001030d-dfbd-4b31-9ee7-231a59ae71ad resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87652025-01-15T00:53:25.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2001030d-dfbd-4b31-9ee7-231a59ae71ad response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87662025-01-15T00:53:26.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 51349f0b-a50d-48fd-8516-71517f87b5c2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87672025-01-15T00:53:26.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 51349f0b-a50d-48fd-8516-71517f87b5c2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87682025-01-15T00:53:26.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2673 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 51349f0b-a50d-48fd-8516-71517f87b5c2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87692025-01-15T00:53:27.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e735ced8-c3ff-4175-9cec-cd7efe4e738e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87702025-01-15T00:53:27.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e735ced8-c3ff-4175-9cec-cd7efe4e738e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87712025-01-15T00:53:27.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e735ced8-c3ff-4175-9cec-cd7efe4e738e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87722025-01-15T00:53:28.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b0369445-0dfa-46fa-828a-0397851d32e5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87732025-01-15T00:53:28.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b0369445-0dfa-46fa-828a-0397851d32e5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87742025-01-15T00:53:28.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b0369445-0dfa-46fa-828a-0397851d32e5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87752025-01-15T00:53:29.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d76b20e-183f-45fb-ac30-9cdc13e00aab roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87762025-01-15T00:53:29.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d76b20e-183f-45fb-ac30-9cdc13e00aab resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87772025-01-15T00:53:29.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d76b20e-183f-45fb-ac30-9cdc13e00aab response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87782025-01-15T00:53:30.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = aa428cdb-f82e-4f9a-9954-0cdc531b8a64 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87792025-01-15T00:53:30.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = aa428cdb-f82e-4f9a-9954-0cdc531b8a64 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87802025-01-15T00:53:30.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2210 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = aa428cdb-f82e-4f9a-9954-0cdc531b8a64 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87812025-01-15T00:53:31.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 956a7c48-e667-40a9-b5a4-bbef284872ec roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87822025-01-15T00:53:31.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 956a7c48-e667-40a9-b5a4-bbef284872ec resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87832025-01-15T00:53:31.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2682 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 956a7c48-e667-40a9-b5a4-bbef284872ec response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
87842025-01-15T00:53:32.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
87852025-01-15T00:53:32.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87862025-01-15T00:53:32.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87872025-01-15T00:53:32.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87882025-01-15T00:53:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87892025-01-15T00:53:32.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87902025-01-15T00:53:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87912025-01-15T00:53:32.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
87922025-01-15T00:53:32.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87932025-01-15T00:53:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87942025-01-15T00:53:32.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87952025-01-15T00:53:32.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87962025-01-15T00:53:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87972025-01-15T00:53:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87982025-01-15T00:53:32.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.437066ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87992025-01-15T00:53:32.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88002025-01-15T00:53:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
88012025-01-15T00:53:32.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88022025-01-15T00:53:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88032025-01-15T00:53:32.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
88042025-01-15T00:53:32.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.000925ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
88052025-01-15T00:53:32.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 595f6dde-a5f2-45a6-9391-6e77ebd01d1b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88062025-01-15T00:53:32.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 595f6dde-a5f2-45a6-9391-6e77ebd01d1b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88072025-01-15T00:53:32.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1508 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 595f6dde-a5f2-45a6-9391-6e77ebd01d1b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88082025-01-15T00:53:33.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7b9be105-d08f-45b8-baa8-b9c95b1e4ac6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88092025-01-15T00:53:33.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7b9be105-d08f-45b8-baa8-b9c95b1e4ac6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88102025-01-15T00:53:33.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7b9be105-d08f-45b8-baa8-b9c95b1e4ac6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88112025-01-15T00:53:34.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 4c20e8f2-0a3b-45a2-abee-07376b4280d3 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
88122025-01-15T00:53:34.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 4c20e8f2-0a3b-45a2-abee-07376b4280d3 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
88132025-01-15T00:53:34.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3247 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 4c20e8f2-0a3b-45a2-abee-07376b4280d3 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
88142025-01-15T00:53:34.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 0c67c90f-63aa-4dfa-9fe7-a9703e44d923 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
88152025-01-15T00:53:34.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 0c67c90f-63aa-4dfa-9fe7-a9703e44d923 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
88162025-01-15T00:53:34.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 0c67c90f-63aa-4dfa-9fe7-a9703e44d923 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
88172025-01-15T00:53:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 491 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = ef22b593-b950-4d80-ad77-809b9b3e4ce0 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
88182025-01-15T00:53:34.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 298cb344-2f6d-4dac-9640-75212757358f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88192025-01-15T00:53:34.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 298cb344-2f6d-4dac-9640-75212757358f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88202025-01-15T00:53:34.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 298cb344-2f6d-4dac-9640-75212757358f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88212025-01-15T00:53:35.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bb12700e-db9d-4cd5-8e56-8bac5e0f513e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88222025-01-15T00:53:35.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bb12700e-db9d-4cd5-8e56-8bac5e0f513e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88232025-01-15T00:53:35.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1805 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bb12700e-db9d-4cd5-8e56-8bac5e0f513e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88242025-01-15T00:53:36.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9fca43e3-a832-495b-9f55-b26cdf6c3f1e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88252025-01-15T00:53:36.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9fca43e3-a832-495b-9f55-b26cdf6c3f1e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88262025-01-15T00:53:36.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2268 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9fca43e3-a832-495b-9f55-b26cdf6c3f1e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88272025-01-15T00:53:37.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b64977a-c23c-4234-85d8-308118f81ef0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88282025-01-15T00:53:37.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b64977a-c23c-4234-85d8-308118f81ef0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88292025-01-15T00:53:37.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b64977a-c23c-4234-85d8-308118f81ef0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88302025-01-15T00:53:38.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 22b85b99-5523-4fd2-bf0d-510c8577c0b1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88312025-01-15T00:53:38.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 22b85b99-5523-4fd2-bf0d-510c8577c0b1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88322025-01-15T00:53:38.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2139 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 22b85b99-5523-4fd2-bf0d-510c8577c0b1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88332025-01-15T00:53:39.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9ee2a25e-b355-41d3-8dcc-cf08d7d4a7c5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88342025-01-15T00:53:39.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9ee2a25e-b355-41d3-8dcc-cf08d7d4a7c5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88352025-01-15T00:53:39.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9ee2a25e-b355-41d3-8dcc-cf08d7d4a7c5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88362025-01-15T00:53:40.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd26e164-93f9-442a-8d4d-11aaf17f1d89 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88372025-01-15T00:53:40.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd26e164-93f9-442a-8d4d-11aaf17f1d89 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88382025-01-15T00:53:40.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1738 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd26e164-93f9-442a-8d4d-11aaf17f1d89 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88392025-01-15T00:53:42.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ed349be6-9765-493a-b261-906a25587201 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88402025-01-15T00:53:42.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ed349be6-9765-493a-b261-906a25587201 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88412025-01-15T00:53:42.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2761 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ed349be6-9765-493a-b261-906a25587201 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88422025-01-15T00:53:42.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
88432025-01-15T00:53:42.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88442025-01-15T00:53:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88452025-01-15T00:53:42.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88462025-01-15T00:53:42.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
88472025-01-15T00:53:42.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88482025-01-15T00:53:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88492025-01-15T00:53:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88502025-01-15T00:53:42.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88512025-01-15T00:53:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88522025-01-15T00:53:42.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88532025-01-15T00:53:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88542025-01-15T00:53:42.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88552025-01-15T00:53:42.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88562025-01-15T00:53:42.610ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.439376ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88572025-01-15T00:53:42.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88582025-01-15T00:53:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
88592025-01-15T00:53:42.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88602025-01-15T00:53:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88612025-01-15T00:53:42.622ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
88622025-01-15T00:53:42.622ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.266371ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
88632025-01-15T00:53:43.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c751ca50-9e57-47ce-a0a8-1f78c47a9af9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88642025-01-15T00:53:43.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c751ca50-9e57-47ce-a0a8-1f78c47a9af9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88652025-01-15T00:53:43.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2887 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c751ca50-9e57-47ce-a0a8-1f78c47a9af9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88662025-01-15T00:53:44.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32ff414d-6c61-49fd-9067-d214ff4cf5c8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88672025-01-15T00:53:44.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32ff414d-6c61-49fd-9067-d214ff4cf5c8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88682025-01-15T00:53:44.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2724 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32ff414d-6c61-49fd-9067-d214ff4cf5c8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88692025-01-15T00:53:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 514 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 5da69cbf-a200-4da8-be18-5881885e6dc3 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
88702025-01-15T00:53:45.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 89310bef-daaa-40a1-ae15-5be83905fe12 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88712025-01-15T00:53:45.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 89310bef-daaa-40a1-ae15-5be83905fe12 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88722025-01-15T00:53:45.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1771 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 89310bef-daaa-40a1-ae15-5be83905fe12 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88732025-01-15T00:53:46.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0179e074-45dc-45cc-a3ea-50acb5d50bae roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88742025-01-15T00:53:46.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0179e074-45dc-45cc-a3ea-50acb5d50bae resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88752025-01-15T00:53:46.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0179e074-45dc-45cc-a3ea-50acb5d50bae response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88762025-01-15T00:53:47.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 618723ae-b4ce-48ee-b8f0-96625db2db17 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88772025-01-15T00:53:47.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 618723ae-b4ce-48ee-b8f0-96625db2db17 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88782025-01-15T00:53:47.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2668 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 618723ae-b4ce-48ee-b8f0-96625db2db17 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88792025-01-15T00:53:48.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 027d3728-c752-4804-b79b-9b26f6df4b83 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88802025-01-15T00:53:48.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 027d3728-c752-4804-b79b-9b26f6df4b83 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88812025-01-15T00:53:48.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2450 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 027d3728-c752-4804-b79b-9b26f6df4b83 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88822025-01-15T00:53:49.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8d3f9ef-1bae-4d20-b976-25d9c182e881 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88832025-01-15T00:53:49.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8d3f9ef-1bae-4d20-b976-25d9c182e881 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88842025-01-15T00:53:49.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2523 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f8d3f9ef-1bae-4d20-b976-25d9c182e881 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88852025-01-15T00:53:50.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c8186fac-8cc9-4fe7-a97d-381e13fb0df7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88862025-01-15T00:53:50.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c8186fac-8cc9-4fe7-a97d-381e13fb0df7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88872025-01-15T00:53:50.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c8186fac-8cc9-4fe7-a97d-381e13fb0df7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88882025-01-15T00:53:51.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 710d673a-afae-4ff3-ae47-d4c067bc7dd9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88892025-01-15T00:53:51.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 710d673a-afae-4ff3-ae47-d4c067bc7dd9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88902025-01-15T00:53:51.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 710d673a-afae-4ff3-ae47-d4c067bc7dd9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88912025-01-15T00:53:52.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ffb7ff7-5a9f-41bf-a5f8-9769265489dc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88922025-01-15T00:53:52.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ffb7ff7-5a9f-41bf-a5f8-9769265489dc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88932025-01-15T00:53:52.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ffb7ff7-5a9f-41bf-a5f8-9769265489dc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
88942025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
88952025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
88962025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88972025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
88982025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
88992025-01-15T00:53:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
89002025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.65\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
89012025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
89022025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
89032025-01-15T00:53:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:43:52.603110899 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89042025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89052025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
89062025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89072025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
89082025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89092025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
89102025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89112025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
89122025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
89132025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
89142025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89152025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
89162025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
89172025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
89182025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89192025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
89202025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89212025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89222025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89232025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89242025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89252025-01-15T00:53:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1452, tv_nsec: 933507996 } })
89262025-01-15T00:53:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89272025-01-15T00:53:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1452, tv_nsec: 933603048 } })
89282025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
89292025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 896.577\u{b5}s iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
89302025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
89312025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.076821ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
89322025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
89332025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89342025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
89352025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
89362025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89372025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
89382025-01-15T00:53:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
89392025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89402025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
89412025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89422025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
89432025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89442025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89452025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89462025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89472025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89482025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89492025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89502025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89512025-01-15T00:53:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89522025-01-15T00:53:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89532025-01-15T00:53:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89542025-01-15T00:53:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89552025-01-15T00:53:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89562025-01-15T00:53:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89572025-01-15T00:53:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
89582025-01-15T00:53:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
89592025-01-15T00:53:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89602025-01-15T00:53:52.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89612025-01-15T00:53:52.606ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:43:52.603110899 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
89622025-01-15T00:53:52.606ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.211152ms iteration = 10 status = {"expiration":"2025-01-15T00:43:52.603110899Z","pruned":[]}
89632025-01-15T00:53:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89642025-01-15T00:53:52.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1452, tv_nsec: 936538514 } })
89652025-01-15T00:53:52.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.622169ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89662025-01-15T00:53:52.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
89672025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89682025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
89692025-01-15T00:53:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89702025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89712025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
89722025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
89732025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89742025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89752025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
89762025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89772025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89782025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
89792025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89802025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
89812025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89822025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
89832025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89842025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89852025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89862025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89872025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89882025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89892025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89902025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89912025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89922025-01-15T00:53:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89932025-01-15T00:53:52.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1452, tv_nsec: 938165966 } })
89942025-01-15T00:53:52.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
89952025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89962025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89972025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89982025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
89992025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
90002025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90012025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
90022025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
90032025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
90042025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
90052025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
90062025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
90072025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
90082025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
90092025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90102025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
90112025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
90122025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90132025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90142025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90152025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
90162025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90172025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
90182025-01-15T00:53:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90192025-01-15T00:53:52.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90202025-01-15T00:53:52.611ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90212025-01-15T00:53:52.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90222025-01-15T00:53:52.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90232025-01-15T00:53:52.612ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90242025-01-15T00:53:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
90252025-01-15T00:53:52.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90262025-01-15T00:53:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90272025-01-15T00:53:52.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90282025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90292025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90302025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
90312025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90322025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90332025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90342025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90352025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90362025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90372025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90382025-01-15T00:53:52.615ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90392025-01-15T00:53:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90402025-01-15T00:53:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
90412025-01-15T00:53:52.616ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90422025-01-15T00:53:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
90432025-01-15T00:53:52.617ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90442025-01-15T00:53:52.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90452025-01-15T00:53:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90462025-01-15T00:53:52.619ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90472025-01-15T00:53:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90482025-01-15T00:53:52.619ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90492025-01-15T00:53:52.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90502025-01-15T00:53:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90512025-01-15T00:53:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90522025-01-15T00:53:52.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90532025-01-15T00:53:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90542025-01-15T00:53:52.621ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90552025-01-15T00:53:52.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90562025-01-15T00:53:52.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90572025-01-15T00:53:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90582025-01-15T00:53:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90592025-01-15T00:53:52.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90602025-01-15T00:53:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90612025-01-15T00:53:52.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90622025-01-15T00:53:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
90632025-01-15T00:53:52.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
90642025-01-15T00:53:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
90652025-01-15T00:53:52.628ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90662025-01-15T00:53:52.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90672025-01-15T00:53:52.629ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.483824ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
90682025-01-15T00:53:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90692025-01-15T00:53:52.629ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.985584ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
90702025-01-15T00:53:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90712025-01-15T00:53:52.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90722025-01-15T00:53:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90732025-01-15T00:53:52.633ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90742025-01-15T00:53:52.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90752025-01-15T00:53:52.634ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1452, tv_nsec: 964702026 } })
90762025-01-15T00:53:52.635ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
90772025-01-15T00:53:52.635ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90782025-01-15T00:53:52.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90792025-01-15T00:53:52.636ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90802025-01-15T00:53:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90812025-01-15T00:53:52.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = ea0c4a09-aeb1-498e-831b-e72b8fdc0760 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
90822025-01-15T00:53:52.638ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 33.888112ms iteration = 5 status = {"nsuccess":5}
90832025-01-15T00:53:52.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = ea0c4a09-aeb1-498e-831b-e72b8fdc0760 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
90842025-01-15T00:53:52.640ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90852025-01-15T00:53:52.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90862025-01-15T00:53:52.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90872025-01-15T00:53:52.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
90882025-01-15T00:53:52.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90892025-01-15T00:53:52.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90902025-01-15T00:53:52.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90912025-01-15T00:53:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90922025-01-15T00:53:52.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90932025-01-15T00:53:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90942025-01-15T00:53:52.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 16419 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = ea0c4a09-aeb1-498e-831b-e72b8fdc0760 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
90952025-01-15T00:53:52.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90962025-01-15T00:53:52.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90972025-01-15T00:53:52.664ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90982025-01-15T00:53:52.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90992025-01-15T00:53:52.665ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91002025-01-15T00:53:52.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91012025-01-15T00:53:52.670ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
91022025-01-15T00:53:52.670ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
91032025-01-15T00:53:52.670ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
91042025-01-15T00:53:52.670ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91052025-01-15T00:53:52.670ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91062025-01-15T00:53:52.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91072025-01-15T00:53:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91082025-01-15T00:53:52.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91092025-01-15T00:53:52.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91102025-01-15T00:53:52.673ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
91112025-01-15T00:53:52.673ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
91122025-01-15T00:53:52.673ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 64.273727ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
91132025-01-15T00:53:52.674ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91142025-01-15T00:53:52.674ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91152025-01-15T00:53:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91162025-01-15T00:53:52.676ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91172025-01-15T00:53:52.676ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91182025-01-15T00:53:52.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91192025-01-15T00:53:52.678ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91202025-01-15T00:53:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91212025-01-15T00:53:52.678ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91222025-01-15T00:53:52.678ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
91232025-01-15T00:53:52.678ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91242025-01-15T00:53:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91252025-01-15T00:53:52.679ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91262025-01-15T00:53:52.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91272025-01-15T00:53:52.679ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91282025-01-15T00:53:52.679ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
91292025-01-15T00:53:52.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91302025-01-15T00:53:52.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91312025-01-15T00:53:52.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.034878ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
91322025-01-15T00:53:52.680ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91332025-01-15T00:53:52.680ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 71.246551ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
91342025-01-15T00:53:52.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91352025-01-15T00:53:52.681ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91362025-01-15T00:53:52.681ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
91372025-01-15T00:53:52.681ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91382025-01-15T00:53:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91392025-01-15T00:53:52.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91402025-01-15T00:53:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91412025-01-15T00:53:52.681ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91422025-01-15T00:53:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91432025-01-15T00:53:52.683ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
91442025-01-15T00:53:52.683ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
91452025-01-15T00:53:52.683ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.672054ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
91462025-01-15T00:53:52.683ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
91472025-01-15T00:53:52.683ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 75.742058ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
91482025-01-15T00:53:52.683ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91492025-01-15T00:53:52.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91502025-01-15T00:53:52.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91512025-01-15T00:53:52.688ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91522025-01-15T00:53:52.693ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.416707ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
91532025-01-15T00:53:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
91542025-01-15T00:53:52.693ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91552025-01-15T00:53:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91562025-01-15T00:53:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
91572025-01-15T00:53:52.693ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91582025-01-15T00:53:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91592025-01-15T00:53:52.695ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91602025-01-15T00:53:52.697ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91612025-01-15T00:53:52.697ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91622025-01-15T00:53:52.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91632025-01-15T00:53:52.698ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 94.113651ms iteration = 19 status = 0
91642025-01-15T00:53:52.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91652025-01-15T00:53:52.703ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
91662025-01-15T00:53:52.703ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91672025-01-15T00:53:52.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91682025-01-15T00:53:52.707ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
91692025-01-15T00:53:52.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
91702025-01-15T00:53:52.708ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 100.657587ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91712025-01-15T00:53:52.713ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
91722025-01-15T00:53:52.713ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 106.032111ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
91732025-01-15T00:53:52.716ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
91742025-01-15T00:53:52.716ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
91752025-01-15T00:53:52.716ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
91762025-01-15T00:53:52.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91772025-01-15T00:53:52.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91782025-01-15T00:53:52.717ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 109.493337ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
91792025-01-15T00:53:52.717ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
91802025-01-15T00:53:52.717ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.043455ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
91812025-01-15T00:53:52.720ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91822025-01-15T00:53:52.725ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91832025-01-15T00:53:52.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91842025-01-15T00:53:52.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91852025-01-15T00:53:52.730ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
91862025-01-15T00:53:52.730ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 126.111178ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
91872025-01-15T00:53:52.737ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.917438ms iteration = 21 status = {"physical_disks_added":0}
91882025-01-15T00:53:52.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91892025-01-15T00:53:52.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91902025-01-15T00:53:52.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 134.893206ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
91912025-01-15T00:53:52.746ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
91922025-01-15T00:53:52.746ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 141.692247ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
91932025-01-15T00:53:52.751ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
91942025-01-15T00:53:52.753ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
91952025-01-15T00:53:52.755ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
91962025-01-15T00:53:52.755ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91972025-01-15T00:53:52.755ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "045e6b06-a540-412e-a386-fc166115f31d", "content-length": "26", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} })
91982025-01-15T00:53:52.755ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91992025-01-15T00:53:52.757ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92002025-01-15T00:53:52.766ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
92012025-01-15T00:53:52.766ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92022025-01-15T00:53:52.766ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b33b7c1b-41a8-4320-b814-1964be3736ac", "content-length": "26", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} })
92032025-01-15T00:53:52.766ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92042025-01-15T00:53:52.768ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92052025-01-15T00:53:52.777ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92062025-01-15T00:53:52.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92072025-01-15T00:53:52.923ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
92082025-01-15T00:53:52.923ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92092025-01-15T00:53:52.923ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c02ffeee-9a9f-4dc3-8624-91f5170fcc8a", "content-length": "26", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} })
92102025-01-15T00:53:52.923ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92112025-01-15T00:53:52.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
92122025-01-15T00:53:52.935ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92132025-01-15T00:53:52.935ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "516b05a2-b79c-423c-b52d-95b6c9a990a9", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92142025-01-15T00:53:52.935ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92152025-01-15T00:53:52.935ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
92162025-01-15T00:53:52.937ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "01471d54-d829-4eea-9f24-a35d7220abd7", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92172025-01-15T00:53:52.937ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92182025-01-15T00:53:52.939ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 336.299202ms iteration = 19 status = {}
92192025-01-15T00:53:52.940ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92202025-01-15T00:53:52.940ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 337.835782ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92212025-01-15T00:53:53.039ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
92222025-01-15T00:53:53.039ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92232025-01-15T00:53:53.039ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d200b21b-7efa-4ee1-9aec-489913807964", "content-length": "372", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} })
92242025-01-15T00:53:53.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92252025-01-15T00:53:53.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92262025-01-15T00:53:53.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92272025-01-15T00:53:53.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92282025-01-15T00:53:53.042ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
92292025-01-15T00:53:53.042ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
92302025-01-15T00:53:53.042ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
92312025-01-15T00:53:53.042ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 438.950538ms iteration = 10 status = {"generation":2}
92322025-01-15T00:53:53.044ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92332025-01-15T00:53:53.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92342025-01-15T00:53:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92352025-01-15T00:53:53.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92362025-01-15T00:53:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92372025-01-15T00:53:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92382025-01-15T00:53:53.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92392025-01-15T00:53:53.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
92402025-01-15T00:53:53.047ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92412025-01-15T00:53:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92422025-01-15T00:53:53.049ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92432025-01-15T00:53:53.049ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "09e086ed-a897-4126-a6af-de017a615039", "content-length": "1", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} })
92442025-01-15T00:53:53.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92452025-01-15T00:53:53.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92462025-01-15T00:53:53.053ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 450.155943ms iteration = 19 status = null
92472025-01-15T00:53:53.054ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
92482025-01-15T00:53:53.054ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9661029f-237d-4707-b20c-8944912ae9dc", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92492025-01-15T00:53:53.054ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92502025-01-15T00:53:53.055ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "311afa57-e022-4d82-bd7e-a584bde70528", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92512025-01-15T00:53:53.056ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92522025-01-15T00:53:53.057ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5545f6b7-c747-4f82-8fba-674129872a2c", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92532025-01-15T00:53:53.057ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92542025-01-15T00:53:53.059ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
92552025-01-15T00:53:53.059ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 456.817492ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92562025-01-15T00:53:53.074ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
92572025-01-15T00:53:53.074ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
92582025-01-15T00:53:53.074ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92592025-01-15T00:53:53.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92602025-01-15T00:53:53.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92612025-01-15T00:53:53.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92622025-01-15T00:53:53.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92632025-01-15T00:53:53.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92642025-01-15T00:53:53.080ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
92652025-01-15T00:53:53.080ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92662025-01-15T00:53:53.080ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
92672025-01-15T00:53:53.080ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 477.557191ms iteration = 10 status = {"generation":1}
92682025-01-15T00:53:53.081ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
92692025-01-15T00:53:53.081ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
92702025-01-15T00:53:53.082ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c6616b7e-a712-4736-8ece-edea38e704bc", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} })
92712025-01-15T00:53:53.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92722025-01-15T00:53:53.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92732025-01-15T00:53:53.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92742025-01-15T00:53:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92752025-01-15T00:53:53.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92762025-01-15T00:53:53.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92772025-01-15T00:53:53.090ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
92782025-01-15T00:53:53.090ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
92792025-01-15T00:53:53.090ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "eb96b11e-b53f-4213-b590-50b9e6da1582", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} })
92802025-01-15T00:53:53.092ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 485.237398ms iteration = 19 status = {}
92812025-01-15T00:53:53.120ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92822025-01-15T00:53:53.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92832025-01-15T00:53:53.139ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92842025-01-15T00:53:53.140ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7d23ba4-c326-4073-8624-0f12753c82be", "content-length": "691", "date": "Wed, 15 Jan 2025 00:53:52 GMT"} })
92852025-01-15T00:53:53.140ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
92862025-01-15T00:53:53.140ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
92872025-01-15T00:53:53.140ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
92882025-01-15T00:53:53.141ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
92892025-01-15T00:53:53.141ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92902025-01-15T00:53:53.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92912025-01-15T00:53:53.142ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 534.931025ms iteration = 19 status = {}
92922025-01-15T00:53:53.150ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
92932025-01-15T00:53:53.151ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1b4b211-489a-4a57-8839-4bdd0622879e", "content-length": "134", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} })
92942025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
92952025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
92962025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
92972025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
92982025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92992025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93002025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93012025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93022025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
93032025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
93042025-01-15T00:53:53.151ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
93052025-01-15T00:53:53.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93062025-01-15T00:53:53.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93072025-01-15T00:53:53.153ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
93082025-01-15T00:53:53.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "de240b14-90e5-4800-9231-71fe0fad4310", "content-length": "2", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} })
93092025-01-15T00:53:53.154ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
93102025-01-15T00:53:53.154ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "19c8863a-4e5b-4bb5-8994-0db216c89100", "content-length": "51", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} })
93112025-01-15T00:53:53.154ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
93122025-01-15T00:53:53.154ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
93132025-01-15T00:53:53.249ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6ad87f9e-25e6-4b18-b674-57a75c8f756d", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} })
93142025-01-15T00:53:53.249ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
93152025-01-15T00:53:53.249ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
93162025-01-15T00:53:53.249ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f041ae2-559e-4fe2-9fcf-68cbc29dcd88", "content-length": "682", "date": "Wed, 15 Jan 2025 00:53:53 GMT"} })
93172025-01-15T00:53:53.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93182025-01-15T00:53:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93192025-01-15T00:53:53.252ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93202025-01-15T00:53:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93212025-01-15T00:53:53.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93222025-01-15T00:53:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93232025-01-15T00:53:53.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b985d90c-24bf-4fc9-9b22-c9be498b5a99 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93242025-01-15T00:53:53.256ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b985d90c-24bf-4fc9-9b22-c9be498b5a99 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93252025-01-15T00:53:53.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93262025-01-15T00:53:53.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93272025-01-15T00:53:53.258ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b985d90c-24bf-4fc9-9b22-c9be498b5a99 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93282025-01-15T00:53:53.265ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 661.148364ms iteration = 19 status = {}
93292025-01-15T00:53:54.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0bcef906-6b20-4cfc-a990-5baf11ac4e13 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93302025-01-15T00:53:54.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0bcef906-6b20-4cfc-a990-5baf11ac4e13 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93312025-01-15T00:53:54.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2916 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0bcef906-6b20-4cfc-a990-5baf11ac4e13 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93322025-01-15T00:53:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 582 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = fac6a175-3e8e-45f1-b88a-46d0afe7f9b7 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
93332025-01-15T00:53:55.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 660f4ef6-d789-4e27-9374-7fdbd65fd5a0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93342025-01-15T00:53:55.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 660f4ef6-d789-4e27-9374-7fdbd65fd5a0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93352025-01-15T00:53:55.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2704 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 660f4ef6-d789-4e27-9374-7fdbd65fd5a0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93362025-01-15T00:53:56.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f3f0c2cd-9b6b-48ed-be14-a181643604e7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93372025-01-15T00:53:56.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f3f0c2cd-9b6b-48ed-be14-a181643604e7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93382025-01-15T00:53:56.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2556 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f3f0c2cd-9b6b-48ed-be14-a181643604e7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93392025-01-15T00:53:57.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 42fedddf-a1ec-4758-b422-88b82fc4cda6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93402025-01-15T00:53:57.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 42fedddf-a1ec-4758-b422-88b82fc4cda6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93412025-01-15T00:53:57.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 42fedddf-a1ec-4758-b422-88b82fc4cda6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93422025-01-15T00:53:58.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 831bb392-aa64-4adc-a645-7320d7175b31 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93432025-01-15T00:53:58.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 831bb392-aa64-4adc-a645-7320d7175b31 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93442025-01-15T00:53:58.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2550 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 831bb392-aa64-4adc-a645-7320d7175b31 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93452025-01-15T00:53:59.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac3ac5d9-0529-42d7-b370-8f2f8834dabc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93462025-01-15T00:53:59.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac3ac5d9-0529-42d7-b370-8f2f8834dabc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93472025-01-15T00:53:59.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2213 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ac3ac5d9-0529-42d7-b370-8f2f8834dabc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93482025-01-15T00:54:00.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3289de41-d0af-4dee-baa5-d63b2f78ed20 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93492025-01-15T00:54:00.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3289de41-d0af-4dee-baa5-d63b2f78ed20 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93502025-01-15T00:54:00.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2218 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3289de41-d0af-4dee-baa5-d63b2f78ed20 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93512025-01-15T00:54:01.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60d3612d-f92e-4c43-ba06-abb8f6ce0857 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93522025-01-15T00:54:01.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60d3612d-f92e-4c43-ba06-abb8f6ce0857 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93532025-01-15T00:54:01.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2458 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60d3612d-f92e-4c43-ba06-abb8f6ce0857 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93542025-01-15T00:54:02.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4bd3c85-a166-40a5-9aa2-c609f6ce1ea9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93552025-01-15T00:54:02.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4bd3c85-a166-40a5-9aa2-c609f6ce1ea9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93562025-01-15T00:54:02.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1737 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4bd3c85-a166-40a5-9aa2-c609f6ce1ea9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93572025-01-15T00:54:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
93582025-01-15T00:54:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93592025-01-15T00:54:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93602025-01-15T00:54:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93612025-01-15T00:54:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93622025-01-15T00:54:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93632025-01-15T00:54:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93642025-01-15T00:54:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
93652025-01-15T00:54:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93662025-01-15T00:54:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93672025-01-15T00:54:02.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93682025-01-15T00:54:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93692025-01-15T00:54:02.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93702025-01-15T00:54:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93712025-01-15T00:54:02.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93722025-01-15T00:54:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
93732025-01-15T00:54:02.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93742025-01-15T00:54:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93752025-01-15T00:54:02.629ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
93762025-01-15T00:54:02.629ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.106083ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
93772025-01-15T00:54:02.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.566322ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93782025-01-15T00:54:03.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 587b2e09-3d34-4ea6-9b98-77ca6fbfc972 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93792025-01-15T00:54:03.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 587b2e09-3d34-4ea6-9b98-77ca6fbfc972 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93802025-01-15T00:54:03.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 587b2e09-3d34-4ea6-9b98-77ca6fbfc972 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93812025-01-15T00:54:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 646 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = f9ec1b71-2599-4cf4-bfac-507ff39f3f34 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
93822025-01-15T00:54:04.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 92af9a6a-eef9-4758-95d3-1743304f2067 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93832025-01-15T00:54:04.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 92af9a6a-eef9-4758-95d3-1743304f2067 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93842025-01-15T00:54:04.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1874 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 92af9a6a-eef9-4758-95d3-1743304f2067 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93852025-01-15T00:54:05.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4dd36c3-6f93-44f1-a6ad-abf1af7e8b0b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93862025-01-15T00:54:05.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4dd36c3-6f93-44f1-a6ad-abf1af7e8b0b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93872025-01-15T00:54:05.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4dd36c3-6f93-44f1-a6ad-abf1af7e8b0b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93882025-01-15T00:54:06.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cccad0d6-632d-4e82-bcc3-d4bb33b4a39a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93892025-01-15T00:54:06.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cccad0d6-632d-4e82-bcc3-d4bb33b4a39a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93902025-01-15T00:54:06.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1682 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cccad0d6-632d-4e82-bcc3-d4bb33b4a39a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93912025-01-15T00:54:07.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62464018-6112-45f7-9295-c8bcff48af6b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93922025-01-15T00:54:07.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62464018-6112-45f7-9295-c8bcff48af6b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93932025-01-15T00:54:07.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2752 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62464018-6112-45f7-9295-c8bcff48af6b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93942025-01-15T00:54:08.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c5c2eabc-4eca-49ce-b7b7-6adfb3b77661 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93952025-01-15T00:54:08.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c5c2eabc-4eca-49ce-b7b7-6adfb3b77661 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93962025-01-15T00:54:08.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2135 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c5c2eabc-4eca-49ce-b7b7-6adfb3b77661 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93972025-01-15T00:54:09.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f94cd5b-d269-4364-8ca9-a398f0423db0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93982025-01-15T00:54:09.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f94cd5b-d269-4364-8ca9-a398f0423db0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
93992025-01-15T00:54:09.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2666 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f94cd5b-d269-4364-8ca9-a398f0423db0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94002025-01-15T00:54:10.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2e22656f-ae34-4492-b524-dfd9f32b7aaa roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94012025-01-15T00:54:10.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2e22656f-ae34-4492-b524-dfd9f32b7aaa resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94022025-01-15T00:54:10.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2e22656f-ae34-4492-b524-dfd9f32b7aaa response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94032025-01-15T00:54:11.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b734a4b7-5129-4836-b93f-4d5ca998998f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94042025-01-15T00:54:11.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b734a4b7-5129-4836-b93f-4d5ca998998f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94052025-01-15T00:54:11.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2219 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b734a4b7-5129-4836-b93f-4d5ca998998f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94062025-01-15T00:54:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
94072025-01-15T00:54:12.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94082025-01-15T00:54:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94092025-01-15T00:54:12.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94102025-01-15T00:54:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94112025-01-15T00:54:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94122025-01-15T00:54:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94132025-01-15T00:54:12.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
94142025-01-15T00:54:12.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94152025-01-15T00:54:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94162025-01-15T00:54:12.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94172025-01-15T00:54:12.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94182025-01-15T00:54:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94192025-01-15T00:54:12.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94202025-01-15T00:54:12.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94212025-01-15T00:54:12.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.480426ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94222025-01-15T00:54:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
94232025-01-15T00:54:12.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94242025-01-15T00:54:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94252025-01-15T00:54:12.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
94262025-01-15T00:54:12.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.346521ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
94272025-01-15T00:54:12.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a61f8bf4-0792-49e9-bdcd-09275674f196 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94282025-01-15T00:54:12.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a61f8bf4-0792-49e9-bdcd-09275674f196 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94292025-01-15T00:54:12.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a61f8bf4-0792-49e9-bdcd-09275674f196 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94302025-01-15T00:54:13.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8749ef92-1740-48db-8a13-932636227036 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94312025-01-15T00:54:13.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8749ef92-1740-48db-8a13-932636227036 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94322025-01-15T00:54:13.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8749ef92-1740-48db-8a13-932636227036 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94332025-01-15T00:54:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 534 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 6e1ecfaa-82ce-4d76-abe5-efaaad87ce6f response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
94342025-01-15T00:54:14.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a93b701-af19-4bb8-b841-c4fb8cc9a644 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94352025-01-15T00:54:14.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a93b701-af19-4bb8-b841-c4fb8cc9a644 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94362025-01-15T00:54:14.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2172 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a93b701-af19-4bb8-b841-c4fb8cc9a644 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94372025-01-15T00:54:15.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09380b39-dd79-452e-8d4d-094aab901130 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94382025-01-15T00:54:15.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09380b39-dd79-452e-8d4d-094aab901130 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94392025-01-15T00:54:15.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2299 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09380b39-dd79-452e-8d4d-094aab901130 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94402025-01-15T00:54:16.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6f7f9eae-f9fc-4eff-9073-57d766a7443c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94412025-01-15T00:54:16.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6f7f9eae-f9fc-4eff-9073-57d766a7443c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94422025-01-15T00:54:16.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6f7f9eae-f9fc-4eff-9073-57d766a7443c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94432025-01-15T00:54:17.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 758d536d-f035-4d24-907a-5c54132b3a7a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94442025-01-15T00:54:17.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 758d536d-f035-4d24-907a-5c54132b3a7a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94452025-01-15T00:54:17.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 758d536d-f035-4d24-907a-5c54132b3a7a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94462025-01-15T00:54:18.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5758a8d8-22b9-48a7-a3bf-6fa255dc350a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94472025-01-15T00:54:18.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5758a8d8-22b9-48a7-a3bf-6fa255dc350a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94482025-01-15T00:54:18.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2499 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5758a8d8-22b9-48a7-a3bf-6fa255dc350a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94492025-01-15T00:54:19.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 91feb83e-57e5-4ecb-8cb8-7d03945d93c3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94502025-01-15T00:54:19.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 91feb83e-57e5-4ecb-8cb8-7d03945d93c3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94512025-01-15T00:54:19.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 91feb83e-57e5-4ecb-8cb8-7d03945d93c3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94522025-01-15T00:54:20.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a592ca2a-a732-483a-a86c-2ec68d4a510c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94532025-01-15T00:54:20.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a592ca2a-a732-483a-a86c-2ec68d4a510c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94542025-01-15T00:54:20.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1974 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a592ca2a-a732-483a-a86c-2ec68d4a510c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94552025-01-15T00:54:21.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49b3c5b1-8370-4bd2-8042-f971f5f8793d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94562025-01-15T00:54:21.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49b3c5b1-8370-4bd2-8042-f971f5f8793d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94572025-01-15T00:54:21.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4487 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49b3c5b1-8370-4bd2-8042-f971f5f8793d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
94582025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
94592025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94602025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
94612025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
94622025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
94632025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94642025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
94652025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94662025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
94672025-01-15T00:54:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94682025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
94692025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
94702025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
94712025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
94722025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94732025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94742025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94752025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
94762025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94772025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94782025-01-15T00:54:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1482, tv_nsec: 935429833 } })
94792025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94802025-01-15T00:54:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
94812025-01-15T00:54:22.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
94822025-01-15T00:54:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1482, tv_nsec: 936131906 } })
94832025-01-15T00:54:22.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94842025-01-15T00:54:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
94852025-01-15T00:54:22.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.574499ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
94862025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94872025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
94882025-01-15T00:54:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
94892025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94902025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
94912025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94922025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
94932025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
94942025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94952025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
94962025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94972025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
94982025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
94992025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
95002025-01-15T00:54:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95012025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95022025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95032025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95042025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95052025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95062025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95072025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95082025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
95092025-01-15T00:54:22.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95102025-01-15T00:54:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95112025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
95122025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
95132025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
95142025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
95152025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
95162025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
95172025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
95182025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95192025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
95202025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
95212025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95222025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95232025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
95242025-01-15T00:54:22.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
95252025-01-15T00:54:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
95262025-01-15T00:54:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
95272025-01-15T00:54:22.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95282025-01-15T00:54:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95292025-01-15T00:54:22.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95302025-01-15T00:54:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
95312025-01-15T00:54:22.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95322025-01-15T00:54:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
95332025-01-15T00:54:22.616ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95342025-01-15T00:54:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95352025-01-15T00:54:22.618ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1482, tv_nsec: 948227579 } })
95362025-01-15T00:54:22.618ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
95372025-01-15T00:54:22.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95382025-01-15T00:54:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95392025-01-15T00:54:22.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.962309ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95402025-01-15T00:54:22.627ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95412025-01-15T00:54:22.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95422025-01-15T00:54:22.639ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95432025-01-15T00:54:22.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95442025-01-15T00:54:22.643ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95452025-01-15T00:54:22.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95462025-01-15T00:54:22.645ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95472025-01-15T00:54:22.645ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95482025-01-15T00:54:22.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95492025-01-15T00:54:22.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95502025-01-15T00:54:22.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95512025-01-15T00:54:22.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95522025-01-15T00:54:22.649ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95532025-01-15T00:54:22.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95542025-01-15T00:54:22.650ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95552025-01-15T00:54:22.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95562025-01-15T00:54:22.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
95572025-01-15T00:54:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
95582025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
95592025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95602025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
95612025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95622025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95632025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
95642025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95652025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95662025-01-15T00:54:22.654ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95672025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
95682025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95692025-01-15T00:54:22.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95702025-01-15T00:54:22.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 47.145777ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
95712025-01-15T00:54:22.658ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95722025-01-15T00:54:22.660ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
95732025-01-15T00:54:22.660ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
95742025-01-15T00:54:22.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95752025-01-15T00:54:22.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
95762025-01-15T00:54:22.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
95772025-01-15T00:54:22.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95782025-01-15T00:54:22.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
95792025-01-15T00:54:22.663ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95802025-01-15T00:54:22.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 53.342857ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
95812025-01-15T00:54:22.663ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.462435ms iteration = 20 status = 0
95822025-01-15T00:54:22.663ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
95832025-01-15T00:54:22.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
95842025-01-15T00:54:22.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
95852025-01-15T00:54:22.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95862025-01-15T00:54:22.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
95872025-01-15T00:54:22.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95882025-01-15T00:54:22.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
95892025-01-15T00:54:22.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95902025-01-15T00:54:22.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
95912025-01-15T00:54:22.670ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
95922025-01-15T00:54:22.670ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.86628ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
95932025-01-15T00:54:22.671ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
95942025-01-15T00:54:22.671ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 68.472038ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
95952025-01-15T00:54:22.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 291fcc40-47d5-4c47-bb55-5c2827e70685 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
95962025-01-15T00:54:22.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 291fcc40-47d5-4c47-bb55-5c2827e70685 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
95972025-01-15T00:54:22.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.94812ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95982025-01-15T00:54:22.692ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.641849ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
95992025-01-15T00:54:22.692ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
96002025-01-15T00:54:22.692ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96012025-01-15T00:54:22.693ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb287528-56d1-4ef2-bd8d-a66d97c0325e", "content-length": "26", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96022025-01-15T00:54:22.693ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96032025-01-15T00:54:22.694ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96042025-01-15T00:54:22.694ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
96052025-01-15T00:54:22.694ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 86.786871ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
96062025-01-15T00:54:22.694ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96072025-01-15T00:54:22.694ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
96082025-01-15T00:54:22.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
96092025-01-15T00:54:22.696ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96102025-01-15T00:54:22.696ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d84d6e84-5121-49f5-94a7-4e129b73c125", "content-length": "26", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96112025-01-15T00:54:22.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96122025-01-15T00:54:22.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
96132025-01-15T00:54:22.696ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96142025-01-15T00:54:22.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96152025-01-15T00:54:22.698ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
96162025-01-15T00:54:22.706ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
96172025-01-15T00:54:22.706ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
96182025-01-15T00:54:22.706ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d76f1de9-60ab-48cf-b017-6b90689173be", "content-length": "26", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96192025-01-15T00:54:22.706ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
96202025-01-15T00:54:22.707ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
96212025-01-15T00:54:22.730ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96222025-01-15T00:54:22.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96232025-01-15T00:54:22.803ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 200.587ms iteration = 20 status = {}
96242025-01-15T00:54:22.838ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
96252025-01-15T00:54:22.838ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96262025-01-15T00:54:22.838ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5cd21ae6-26bc-4172-8e65-16bf86bacff0", "content-length": "372", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96272025-01-15T00:54:22.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96282025-01-15T00:54:22.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96292025-01-15T00:54:22.841ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96302025-01-15T00:54:22.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96312025-01-15T00:54:22.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156838 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 291fcc40-47d5-4c47-bb55-5c2827e70685 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
96322025-01-15T00:54:22.864ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
96332025-01-15T00:54:22.864ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "147f0c32-c86c-4c37-836b-62d741417c87", "content-length": "1", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96342025-01-15T00:54:22.866ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96352025-01-15T00:54:22.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96362025-01-15T00:54:22.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96372025-01-15T00:54:22.868ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 265.556491ms iteration = 20 status = null
96382025-01-15T00:54:22.870ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96392025-01-15T00:54:22.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96402025-01-15T00:54:22.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96412025-01-15T00:54:22.870ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96422025-01-15T00:54:22.872ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
96432025-01-15T00:54:22.872ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 266.876046ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
96442025-01-15T00:54:22.872ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96452025-01-15T00:54:22.872ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96462025-01-15T00:54:22.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96472025-01-15T00:54:22.874ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96482025-01-15T00:54:22.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96492025-01-15T00:54:22.886ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
96502025-01-15T00:54:22.886ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
96512025-01-15T00:54:22.886ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fb7fc510-63f0-4e86-ba2c-f3cea070309a", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96522025-01-15T00:54:22.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96532025-01-15T00:54:22.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96542025-01-15T00:54:22.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96552025-01-15T00:54:22.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96562025-01-15T00:54:22.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96572025-01-15T00:54:22.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96582025-01-15T00:54:22.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3e95ca76-72c6-4efe-8571-84a7ea0520c3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
96592025-01-15T00:54:22.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3e95ca76-72c6-4efe-8571-84a7ea0520c3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
96602025-01-15T00:54:22.895ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
96612025-01-15T00:54:22.895ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
96622025-01-15T00:54:22.895ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1944 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3e95ca76-72c6-4efe-8571-84a7ea0520c3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
96632025-01-15T00:54:22.895ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e3b889cb-fd3c-4a9d-b7ef-c658aa0b2a30", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96642025-01-15T00:54:22.897ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 289.985751ms iteration = 20 status = {}
96652025-01-15T00:54:22.905ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 295.633989ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
96662025-01-15T00:54:22.909ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96672025-01-15T00:54:22.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
96682025-01-15T00:54:22.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96692025-01-15T00:54:22.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96702025-01-15T00:54:22.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96712025-01-15T00:54:22.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96722025-01-15T00:54:22.913ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
96732025-01-15T00:54:22.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96742025-01-15T00:54:22.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96752025-01-15T00:54:22.923ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
96762025-01-15T00:54:22.923ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "26f47873-68fd-4f23-a62d-13c4b12c1daf", "content-length": "134", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96772025-01-15T00:54:22.923ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
96782025-01-15T00:54:22.923ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
96792025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
96802025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
96812025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96822025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96832025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96842025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96852025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
96862025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
96872025-01-15T00:54:22.924ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
96882025-01-15T00:54:22.924ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96892025-01-15T00:54:22.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96902025-01-15T00:54:22.926ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
96912025-01-15T00:54:22.926ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0e7340f-bdea-4878-9905-6ad2690a5a25", "content-length": "2", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96922025-01-15T00:54:22.926ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
96932025-01-15T00:54:22.926ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b06f8f12-e2e1-49d5-b66f-e4131fe95284", "content-length": "51", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96942025-01-15T00:54:22.926ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
96952025-01-15T00:54:22.926ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
96962025-01-15T00:54:22.975ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 370.610873ms iteration = 22 status = {"physical_disks_added":0}
96972025-01-15T00:54:23.006ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
96982025-01-15T00:54:23.020ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ed8dc534-1f14-46a8-9435-0c7331cbf7eb", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
96992025-01-15T00:54:23.020ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
97002025-01-15T00:54:23.020ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
97012025-01-15T00:54:23.020ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "38054159-0e38-44ff-be5a-c19263c20fb1", "content-length": "691", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
97022025-01-15T00:54:23.020ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
97032025-01-15T00:54:23.020ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
97042025-01-15T00:54:23.020ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
97052025-01-15T00:54:23.020ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e93e33b9-a302-4ebc-b266-537259440402", "content-length": "682", "date": "Wed, 15 Jan 2025 00:54:22 GMT"} })
97062025-01-15T00:54:23.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97072025-01-15T00:54:23.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97082025-01-15T00:54:23.021ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 413.59408ms iteration = 20 status = {}
97092025-01-15T00:54:23.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97102025-01-15T00:54:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97112025-01-15T00:54:23.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97122025-01-15T00:54:23.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97132025-01-15T00:54:23.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97142025-01-15T00:54:23.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97152025-01-15T00:54:23.038ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 433.138136ms iteration = 20 status = {}
97162025-01-15T00:54:23.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bfac9653-a242-45c7-8633-e3a12a6b2892 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97172025-01-15T00:54:23.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bfac9653-a242-45c7-8633-e3a12a6b2892 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97182025-01-15T00:54:23.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2491 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bfac9653-a242-45c7-8633-e3a12a6b2892 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97192025-01-15T00:54:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 557 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = bf0bb45e-f81c-468f-b3fe-a63630411c50 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
97202025-01-15T00:54:24.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9bda56f-b84a-4877-97b5-22847b8dd319 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97212025-01-15T00:54:24.940ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9bda56f-b84a-4877-97b5-22847b8dd319 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97222025-01-15T00:54:24.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9bda56f-b84a-4877-97b5-22847b8dd319 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97232025-01-15T00:54:25.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 244f143a-b0f0-4d1c-8616-6f6e03b3ab25 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97242025-01-15T00:54:25.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 244f143a-b0f0-4d1c-8616-6f6e03b3ab25 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97252025-01-15T00:54:25.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 244f143a-b0f0-4d1c-8616-6f6e03b3ab25 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97262025-01-15T00:54:26.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = abcceb72-b3dc-4818-b361-15481e8b330e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97272025-01-15T00:54:26.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = abcceb72-b3dc-4818-b361-15481e8b330e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97282025-01-15T00:54:26.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2818 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = abcceb72-b3dc-4818-b361-15481e8b330e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97292025-01-15T00:54:28.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94faea68-19cf-4e68-918c-ae9cf258b2c3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97302025-01-15T00:54:28.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94faea68-19cf-4e68-918c-ae9cf258b2c3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97312025-01-15T00:54:28.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2378 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 94faea68-19cf-4e68-918c-ae9cf258b2c3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97322025-01-15T00:54:29.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09aa724c-5d11-4f5f-8009-75a23d0f153d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97332025-01-15T00:54:29.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09aa724c-5d11-4f5f-8009-75a23d0f153d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97342025-01-15T00:54:29.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09aa724c-5d11-4f5f-8009-75a23d0f153d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97352025-01-15T00:54:30.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea72bd4b-9a74-4fc4-bca8-aea84eb64cc0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97362025-01-15T00:54:30.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea72bd4b-9a74-4fc4-bca8-aea84eb64cc0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97372025-01-15T00:54:30.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea72bd4b-9a74-4fc4-bca8-aea84eb64cc0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97382025-01-15T00:54:31.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37fd752e-f9fb-4d7c-87a3-c462d5102103 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97392025-01-15T00:54:31.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37fd752e-f9fb-4d7c-87a3-c462d5102103 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97402025-01-15T00:54:31.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 37fd752e-f9fb-4d7c-87a3-c462d5102103 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97412025-01-15T00:54:32.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b379787-fb05-42e9-895a-f4722e1c548e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97422025-01-15T00:54:32.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b379787-fb05-42e9-895a-f4722e1c548e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97432025-01-15T00:54:32.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4b379787-fb05-42e9-895a-f4722e1c548e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97442025-01-15T00:54:32.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
97452025-01-15T00:54:32.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97462025-01-15T00:54:32.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97472025-01-15T00:54:32.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
97482025-01-15T00:54:32.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97492025-01-15T00:54:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97502025-01-15T00:54:32.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97512025-01-15T00:54:32.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97522025-01-15T00:54:32.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97532025-01-15T00:54:32.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97542025-01-15T00:54:32.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97552025-01-15T00:54:32.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97562025-01-15T00:54:32.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97572025-01-15T00:54:32.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97582025-01-15T00:54:32.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97592025-01-15T00:54:32.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
97602025-01-15T00:54:32.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97612025-01-15T00:54:32.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97622025-01-15T00:54:32.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.93147ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97632025-01-15T00:54:32.681ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
97642025-01-15T00:54:32.681ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.340677ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
97652025-01-15T00:54:33.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = db66ff4b-4a6e-4579-a447-099425444a9c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97662025-01-15T00:54:33.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = db66ff4b-4a6e-4579-a447-099425444a9c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97672025-01-15T00:54:33.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1727 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = db66ff4b-4a6e-4579-a447-099425444a9c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97682025-01-15T00:54:34.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1a2e30eb-ce99-4eb7-b49d-c3fd590266ec roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97692025-01-15T00:54:34.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1a2e30eb-ce99-4eb7-b49d-c3fd590266ec resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97702025-01-15T00:54:34.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1723 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1a2e30eb-ce99-4eb7-b49d-c3fd590266ec response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97712025-01-15T00:54:34.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = da797028-2469-4b79-bfa5-dd7b679fc1e6 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
97722025-01-15T00:54:34.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = da797028-2469-4b79-bfa5-dd7b679fc1e6 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
97732025-01-15T00:54:34.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3295 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = da797028-2469-4b79-bfa5-dd7b679fc1e6 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
97742025-01-15T00:54:34.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 4c16fd60-5073-4f4c-b378-0b422d4e32d0 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
97752025-01-15T00:54:34.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 4c16fd60-5073-4f4c-b378-0b422d4e32d0 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
97762025-01-15T00:54:34.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2858 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 4c16fd60-5073-4f4c-b378-0b422d4e32d0 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
97772025-01-15T00:54:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 561 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = a429e976-214a-43f8-85ff-78c3d24f4a8c response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
97782025-01-15T00:54:35.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 45d5aed7-a0d1-48f0-b9d9-2d7fbb1b6460 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97792025-01-15T00:54:35.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 45d5aed7-a0d1-48f0-b9d9-2d7fbb1b6460 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97802025-01-15T00:54:35.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 45d5aed7-a0d1-48f0-b9d9-2d7fbb1b6460 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97812025-01-15T00:54:36.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72eda71f-476e-4aef-a133-5c695fa33271 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97822025-01-15T00:54:36.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72eda71f-476e-4aef-a133-5c695fa33271 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97832025-01-15T00:54:36.176ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2465 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72eda71f-476e-4aef-a133-5c695fa33271 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97842025-01-15T00:54:37.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8669eadb-2f01-409d-a370-947b7ebcb6bc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97852025-01-15T00:54:37.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8669eadb-2f01-409d-a370-947b7ebcb6bc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97862025-01-15T00:54:37.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8669eadb-2f01-409d-a370-947b7ebcb6bc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97872025-01-15T00:54:38.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ec0c64e-e837-4246-9b0e-0eb07b93a53e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97882025-01-15T00:54:38.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ec0c64e-e837-4246-9b0e-0eb07b93a53e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97892025-01-15T00:54:38.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ec0c64e-e837-4246-9b0e-0eb07b93a53e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97902025-01-15T00:54:39.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6ced572d-0153-4445-a483-134ab7a6ec86 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97912025-01-15T00:54:39.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6ced572d-0153-4445-a483-134ab7a6ec86 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97922025-01-15T00:54:39.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6ced572d-0153-4445-a483-134ab7a6ec86 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97932025-01-15T00:54:40.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00bafe1c-369f-41bd-a7d9-add5287289a6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97942025-01-15T00:54:40.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00bafe1c-369f-41bd-a7d9-add5287289a6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97952025-01-15T00:54:40.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2575 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 00bafe1c-369f-41bd-a7d9-add5287289a6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97962025-01-15T00:54:41.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a360de87-44d4-41ed-973a-d4ec03e76801 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97972025-01-15T00:54:41.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a360de87-44d4-41ed-973a-d4ec03e76801 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97982025-01-15T00:54:41.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a360de87-44d4-41ed-973a-d4ec03e76801 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
97992025-01-15T00:54:42.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f59ee8ca-4716-4e2c-a671-31866a7e9e04 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98002025-01-15T00:54:42.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f59ee8ca-4716-4e2c-a671-31866a7e9e04 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98012025-01-15T00:54:42.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1636 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f59ee8ca-4716-4e2c-a671-31866a7e9e04 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98022025-01-15T00:54:42.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
98032025-01-15T00:54:42.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98042025-01-15T00:54:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98052025-01-15T00:54:42.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
98062025-01-15T00:54:42.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98072025-01-15T00:54:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98082025-01-15T00:54:42.632ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98092025-01-15T00:54:42.634ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98102025-01-15T00:54:42.634ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98112025-01-15T00:54:42.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98122025-01-15T00:54:42.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98132025-01-15T00:54:42.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98142025-01-15T00:54:42.637ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98152025-01-15T00:54:42.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98162025-01-15T00:54:42.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.008638ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98172025-01-15T00:54:42.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98182025-01-15T00:54:42.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
98192025-01-15T00:54:42.669ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98202025-01-15T00:54:42.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98212025-01-15T00:54:42.679ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
98222025-01-15T00:54:42.679ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.023992ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
98232025-01-15T00:54:43.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 636f25ea-eb5c-4268-afe0-a7cea0497650 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98242025-01-15T00:54:43.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 636f25ea-eb5c-4268-afe0-a7cea0497650 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98252025-01-15T00:54:43.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1973 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 636f25ea-eb5c-4268-afe0-a7cea0497650 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98262025-01-15T00:54:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 536 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = fc823733-4b16-4e2c-ba21-b713fdf0c276 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
98272025-01-15T00:54:44.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 43bc0c6a-0e6b-4802-bdea-4572d8b0b055 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98282025-01-15T00:54:44.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 43bc0c6a-0e6b-4802-bdea-4572d8b0b055 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98292025-01-15T00:54:44.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 43bc0c6a-0e6b-4802-bdea-4572d8b0b055 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98302025-01-15T00:54:45.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80f9d951-3c05-45f7-929f-98a480b2cf1b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98312025-01-15T00:54:45.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80f9d951-3c05-45f7-929f-98a480b2cf1b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98322025-01-15T00:54:45.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80f9d951-3c05-45f7-929f-98a480b2cf1b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98332025-01-15T00:54:46.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5de32de1-5f9b-481a-b615-1fb7c75cc51c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98342025-01-15T00:54:46.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5de32de1-5f9b-481a-b615-1fb7c75cc51c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98352025-01-15T00:54:46.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1795 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5de32de1-5f9b-481a-b615-1fb7c75cc51c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98362025-01-15T00:54:47.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 75dd6405-4fbf-42d3-8cd7-24db588319dd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98372025-01-15T00:54:47.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 75dd6405-4fbf-42d3-8cd7-24db588319dd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98382025-01-15T00:54:47.410ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 75dd6405-4fbf-42d3-8cd7-24db588319dd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98392025-01-15T00:54:48.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6df33d9c-faa5-40c3-9810-f817ed2f4b18 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98402025-01-15T00:54:48.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6df33d9c-faa5-40c3-9810-f817ed2f4b18 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98412025-01-15T00:54:48.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2061 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6df33d9c-faa5-40c3-9810-f817ed2f4b18 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98422025-01-15T00:54:49.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 74c46b08-0763-4c56-bf46-8a756186b300 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98432025-01-15T00:54:49.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 74c46b08-0763-4c56-bf46-8a756186b300 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98442025-01-15T00:54:49.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 74c46b08-0763-4c56-bf46-8a756186b300 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98452025-01-15T00:54:50.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77bab22d-28d4-4617-a69d-380818067e16 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98462025-01-15T00:54:50.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77bab22d-28d4-4617-a69d-380818067e16 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98472025-01-15T00:54:50.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 77bab22d-28d4-4617-a69d-380818067e16 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98482025-01-15T00:54:51.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7c91468-7157-427e-a913-9d440a01e873 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98492025-01-15T00:54:51.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7c91468-7157-427e-a913-9d440a01e873 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98502025-01-15T00:54:51.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1925 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7c91468-7157-427e-a913-9d440a01e873 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98512025-01-15T00:54:52.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6ec765cd-dede-4f1e-8d09-daf02979c436 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98522025-01-15T00:54:52.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6ec765cd-dede-4f1e-8d09-daf02979c436 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98532025-01-15T00:54:52.519ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6ec765cd-dede-4f1e-8d09-daf02979c436 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
98542025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
98552025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98562025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
98572025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
98582025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
98592025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98602025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
98612025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
98622025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98632025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
98642025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
98652025-01-15T00:54:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
98662025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
98672025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.04\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
98682025-01-15T00:54:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:44:52.603447856 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
98692025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
98702025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
98712025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
98722025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98732025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
98742025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98752025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
98762025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
98772025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
98782025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
98792025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98802025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
98812025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98822025-01-15T00:54:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98832025-01-15T00:54:52.604ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1512, tv_nsec: 933807271 } })
98842025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98852025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98862025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
98872025-01-15T00:54:52.604ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1512, tv_nsec: 933892413 } })
98882025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
98892025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 966.228\u{b5}s iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
98902025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
98912025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
98922025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
98932025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
98942025-01-15T00:54:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
98952025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
98962025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
98972025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
98982025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98992025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
99002025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99012025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
99022025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99032025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
99042025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.109152ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
99052025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
99062025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
99072025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99082025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99092025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99102025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
99112025-01-15T00:54:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99122025-01-15T00:54:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
99132025-01-15T00:54:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
99142025-01-15T00:54:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
99152025-01-15T00:54:52.606ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:44:52.603447856 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
99162025-01-15T00:54:52.606ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.266733ms iteration = 11 status = {"expiration":"2025-01-15T00:44:52.603447856Z","pruned":[]}
99172025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.782693ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
99182025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
99192025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
99202025-01-15T00:54:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
99212025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
99222025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99232025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
99242025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99252025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99262025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99272025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
99282025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99292025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
99302025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
99312025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
99322025-01-15T00:54:52.607ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
99332025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
99342025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
99352025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
99362025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
99372025-01-15T00:54:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1512, tv_nsec: 937477952 } })
99382025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99392025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
99402025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
99412025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
99422025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99432025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
99442025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99452025-01-15T00:54:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
99462025-01-15T00:54:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
99472025-01-15T00:54:52.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99482025-01-15T00:54:52.609ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1512, tv_nsec: 939209655 } })
99492025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99502025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
99512025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
99522025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
99532025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
99542025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
99552025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
99562025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
99572025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
99582025-01-15T00:54:52.609ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
99592025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
99602025-01-15T00:54:52.609ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
99612025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
99622025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
99632025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
99642025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
99652025-01-15T00:54:52.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
99662025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
99672025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
99682025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
99692025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
99702025-01-15T00:54:52.609ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
99712025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
99722025-01-15T00:54:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
99732025-01-15T00:54:52.610ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99742025-01-15T00:54:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
99752025-01-15T00:54:52.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99762025-01-15T00:54:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99772025-01-15T00:54:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99782025-01-15T00:54:52.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99792025-01-15T00:54:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99802025-01-15T00:54:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
99812025-01-15T00:54:52.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
99822025-01-15T00:54:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
99832025-01-15T00:54:52.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99842025-01-15T00:54:52.615ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99852025-01-15T00:54:52.615ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99862025-01-15T00:54:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
99872025-01-15T00:54:52.617ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
99882025-01-15T00:54:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
99892025-01-15T00:54:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
99902025-01-15T00:54:52.618ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
99912025-01-15T00:54:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
99922025-01-15T00:54:52.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
99932025-01-15T00:54:52.620ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99942025-01-15T00:54:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
99952025-01-15T00:54:52.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
99962025-01-15T00:54:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
99972025-01-15T00:54:52.625ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.263463ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
99982025-01-15T00:54:52.625ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
99992025-01-15T00:54:52.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100002025-01-15T00:54:52.628ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100012025-01-15T00:54:52.629ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.682149ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
100022025-01-15T00:54:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100032025-01-15T00:54:52.630ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1512, tv_nsec: 960013666 } })
100042025-01-15T00:54:52.630ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
100052025-01-15T00:54:52.632ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100062025-01-15T00:54:52.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100072025-01-15T00:54:52.655ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100082025-01-15T00:54:52.655ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100092025-01-15T00:54:52.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
100102025-01-15T00:54:52.659ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100112025-01-15T00:54:52.659ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100122025-01-15T00:54:52.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100132025-01-15T00:54:52.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100142025-01-15T00:54:52.660ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
100152025-01-15T00:54:52.662ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100162025-01-15T00:54:52.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100172025-01-15T00:54:52.664ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100182025-01-15T00:54:52.665ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100192025-01-15T00:54:52.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100202025-01-15T00:54:52.666ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
100212025-01-15T00:54:52.666ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100222025-01-15T00:54:52.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100232025-01-15T00:54:52.667ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
100242025-01-15T00:54:52.667ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 57.887574ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
100252025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100262025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
100272025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
100282025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100292025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100302025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100312025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100322025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100332025-01-15T00:54:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100342025-01-15T00:54:52.669ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100352025-01-15T00:54:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100362025-01-15T00:54:52.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100372025-01-15T00:54:52.670ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100382025-01-15T00:54:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100392025-01-15T00:54:52.671ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100402025-01-15T00:54:52.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100412025-01-15T00:54:52.672ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100422025-01-15T00:54:52.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100432025-01-15T00:54:52.672ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
100442025-01-15T00:54:52.672ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
100452025-01-15T00:54:52.672ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
100462025-01-15T00:54:52.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100472025-01-15T00:54:52.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100482025-01-15T00:54:52.674ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100492025-01-15T00:54:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100502025-01-15T00:54:52.676ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.149852ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
100512025-01-15T00:54:52.677ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100522025-01-15T00:54:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
100532025-01-15T00:54:52.681ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100542025-01-15T00:54:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100552025-01-15T00:54:52.683ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
100562025-01-15T00:54:52.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
100572025-01-15T00:54:52.684ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100582025-01-15T00:54:52.684ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
100592025-01-15T00:54:52.684ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100602025-01-15T00:54:52.685ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100612025-01-15T00:54:52.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100622025-01-15T00:54:52.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100632025-01-15T00:54:52.686ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100642025-01-15T00:54:52.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100652025-01-15T00:54:52.688ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.884998ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
100662025-01-15T00:54:52.692ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
100672025-01-15T00:54:52.692ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
100682025-01-15T00:54:52.692ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.566039ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
100692025-01-15T00:54:52.695ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100702025-01-15T00:54:52.696ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
100712025-01-15T00:54:52.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100722025-01-15T00:54:52.698ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
100732025-01-15T00:54:52.698ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100742025-01-15T00:54:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100752025-01-15T00:54:52.699ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100762025-01-15T00:54:52.702ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
100772025-01-15T00:54:52.702ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100782025-01-15T00:54:52.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100792025-01-15T00:54:52.712ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
100802025-01-15T00:54:52.712ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
100812025-01-15T00:54:52.712ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
100822025-01-15T00:54:52.712ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100832025-01-15T00:54:52.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100842025-01-15T00:54:52.714ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100852025-01-15T00:54:52.717ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
100862025-01-15T00:54:52.717ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.288729ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
100872025-01-15T00:54:52.719ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
100882025-01-15T00:54:52.719ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100892025-01-15T00:54:52.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100902025-01-15T00:54:52.724ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.798877ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
100912025-01-15T00:54:52.724ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
100922025-01-15T00:54:52.724ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
100932025-01-15T00:54:52.724ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100942025-01-15T00:54:52.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100952025-01-15T00:54:52.726ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
100962025-01-15T00:54:52.726ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
100972025-01-15T00:54:52.726ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 121.952837ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
100982025-01-15T00:54:52.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100992025-01-15T00:54:52.727ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101002025-01-15T00:54:52.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101012025-01-15T00:54:52.727ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101022025-01-15T00:54:52.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101032025-01-15T00:54:52.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101042025-01-15T00:54:52.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101052025-01-15T00:54:52.730ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101062025-01-15T00:54:52.730ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101072025-01-15T00:54:52.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101082025-01-15T00:54:52.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101092025-01-15T00:54:52.731ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101102025-01-15T00:54:52.731ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101112025-01-15T00:54:52.731ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 124.104238ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101122025-01-15T00:54:52.731ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101132025-01-15T00:54:52.731ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 124.301582ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101142025-01-15T00:54:52.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101152025-01-15T00:54:52.733ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
101162025-01-15T00:54:52.733ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
101172025-01-15T00:54:52.733ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
101182025-01-15T00:54:52.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 130.072003ms iteration = 11 status = {"generation":2}
101192025-01-15T00:54:52.734ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
101202025-01-15T00:54:52.734ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101212025-01-15T00:54:52.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101222025-01-15T00:54:52.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101232025-01-15T00:54:52.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101242025-01-15T00:54:52.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101252025-01-15T00:54:52.740ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101262025-01-15T00:54:52.740ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101272025-01-15T00:54:52.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101282025-01-15T00:54:52.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101292025-01-15T00:54:52.742ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101302025-01-15T00:54:52.742ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101312025-01-15T00:54:52.742ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
101322025-01-15T00:54:52.742ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.419796ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
101332025-01-15T00:54:52.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
101342025-01-15T00:54:52.745ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101352025-01-15T00:54:52.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101362025-01-15T00:54:52.746ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
101372025-01-15T00:54:52.746ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101382025-01-15T00:54:52.746ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53fe6337-ef8f-474b-8815-b3215c1571b9", "content-length": "26", "date": "Wed, 15 Jan 2025 00:54:51 GMT"} })
101392025-01-15T00:54:52.746ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101402025-01-15T00:54:52.748ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
101412025-01-15T00:54:52.748ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 145.184524ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
101422025-01-15T00:54:52.749ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
101432025-01-15T00:54:52.749ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
101442025-01-15T00:54:52.749ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
101452025-01-15T00:54:52.749ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101462025-01-15T00:54:52.750ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50070058-8744-4648-94ed-4cebe4c50b8f", "content-length": "26", "date": "Wed, 15 Jan 2025 00:54:51 GMT"} })
101472025-01-15T00:54:52.750ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101482025-01-15T00:54:52.751ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101492025-01-15T00:54:52.770ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
101502025-01-15T00:54:52.770ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 166.108277ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
101512025-01-15T00:54:52.785ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101522025-01-15T00:54:52.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101532025-01-15T00:54:52.786ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 176.887524ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
101542025-01-15T00:54:52.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101552025-01-15T00:54:52.787ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
101562025-01-15T00:54:52.787ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
101572025-01-15T00:54:52.787ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101582025-01-15T00:54:52.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101592025-01-15T00:54:52.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101602025-01-15T00:54:52.789ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
101612025-01-15T00:54:52.789ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 181.635515ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
101622025-01-15T00:54:52.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101632025-01-15T00:54:52.789ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101642025-01-15T00:54:52.791ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101652025-01-15T00:54:52.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101662025-01-15T00:54:52.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
101672025-01-15T00:54:52.793ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101682025-01-15T00:54:52.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101692025-01-15T00:54:52.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101702025-01-15T00:54:52.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101712025-01-15T00:54:52.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101722025-01-15T00:54:52.797ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101732025-01-15T00:54:52.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101742025-01-15T00:54:52.797ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
101752025-01-15T00:54:52.797ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
101762025-01-15T00:54:52.797ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
101772025-01-15T00:54:52.797ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 194.271149ms iteration = 11 status = {"generation":1}
101782025-01-15T00:54:52.799ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101792025-01-15T00:54:52.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101802025-01-15T00:54:52.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101812025-01-15T00:54:52.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101822025-01-15T00:54:52.803ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101832025-01-15T00:54:52.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101842025-01-15T00:54:52.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101852025-01-15T00:54:52.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101862025-01-15T00:54:52.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101872025-01-15T00:54:52.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101882025-01-15T00:54:52.809ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101892025-01-15T00:54:52.812ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
101902025-01-15T00:54:52.812ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101912025-01-15T00:54:52.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101922025-01-15T00:54:52.814ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
101932025-01-15T00:54:52.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
101942025-01-15T00:54:52.821ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 216.863274ms iteration = 23 status = {"physical_disks_added":0}
101952025-01-15T00:54:52.841ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
101962025-01-15T00:54:52.841ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101972025-01-15T00:54:52.842ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53f9c7cc-fa23-4bca-90c6-bf10eb4ef3e0", "content-length": "26", "date": "Wed, 15 Jan 2025 00:54:51 GMT"} })
101982025-01-15T00:54:52.842ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101992025-01-15T00:54:52.843ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102002025-01-15T00:54:52.853ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
102012025-01-15T00:54:52.870ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102022025-01-15T00:54:52.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102032025-01-15T00:54:52.872ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(87544e3f-558e-49c4-a575-93fad3f8d8fd, 0), (0d996814-c4e0-4169-8678-851e25226ae7, 0), (79961366-6ae3-4f37-b55e-b71a716d5cf5, 0), (2337e2c7-288f-4524-b574-9076b1581db9, 0)] collection_id = 87544e3f-558e-49c4-a575-93fad3f8d8fd
102042025-01-15T00:54:52.872ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
102052025-01-15T00:54:52.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
102062025-01-15T00:54:52.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 040eda2d-8d67-420d-ae30-9ce6ad881ceb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
102072025-01-15T00:54:52.874ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 040eda2d-8d67-420d-ae30-9ce6ad881ceb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
102082025-01-15T00:54:52.900ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102092025-01-15T00:54:52.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102102025-01-15T00:54:52.908ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
102112025-01-15T00:54:52.918ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102122025-01-15T00:54:52.919ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2a0eead-7ce3-4f54-a46b-2fe13e031d6b", "content-length": "1", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
102132025-01-15T00:54:52.920ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102142025-01-15T00:54:52.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102152025-01-15T00:54:52.964ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102162025-01-15T00:54:52.964ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102172025-01-15T00:54:52.965ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8502d30-91b6-41f3-b2d4-1eb7c646014a", "content-length": "372", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
102182025-01-15T00:54:52.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102192025-01-15T00:54:52.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102202025-01-15T00:54:52.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102212025-01-15T00:54:52.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102222025-01-15T00:54:52.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102232025-01-15T00:54:52.971ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102242025-01-15T00:54:52.971ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102252025-01-15T00:54:52.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102262025-01-15T00:54:52.974ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102272025-01-15T00:54:52.976ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102282025-01-15T00:54:52.976ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102292025-01-15T00:54:52.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102302025-01-15T00:54:52.977ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.181681ms iteration = 21 status = null
102312025-01-15T00:54:52.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103792 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 040eda2d-8d67-420d-ae30-9ce6ad881ceb response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
102322025-01-15T00:54:52.978ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102332025-01-15T00:54:52.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102342025-01-15T00:54:52.981ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102352025-01-15T00:54:52.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102362025-01-15T00:54:52.982ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102372025-01-15T00:54:52.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102382025-01-15T00:54:52.992ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
102392025-01-15T00:54:52.992ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 389.396274ms iteration = 21 status = {}
102402025-01-15T00:54:52.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8e201f25-0212-490c-93dd-cd7f4a09db95", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102412025-01-15T00:54:52.993ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102422025-01-15T00:54:52.994ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "742e5c9d-aa3c-4296-bc5d-65bda4e8ed05", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102432025-01-15T00:54:52.994ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102442025-01-15T00:54:52.996ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
102452025-01-15T00:54:52.996ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 393.323389ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
102462025-01-15T00:54:53.002ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102472025-01-15T00:54:53.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102482025-01-15T00:54:53.005ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102492025-01-15T00:54:53.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102502025-01-15T00:54:53.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102512025-01-15T00:54:53.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102522025-01-15T00:54:53.017ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
102532025-01-15T00:54:53.018ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "046e416a-3d25-49ce-b214-e4c1f5af10ff", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102542025-01-15T00:54:53.018ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102552025-01-15T00:54:53.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102562025-01-15T00:54:53.020ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2e429154-5e1b-4a78-968d-aae4aca0a25a", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102572025-01-15T00:54:53.020ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102582025-01-15T00:54:53.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
102592025-01-15T00:54:53.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102602025-01-15T00:54:53.022ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8c01babb-76c1-4549-83a5-6ec9f50bd5d0", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102612025-01-15T00:54:53.022ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102622025-01-15T00:54:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102632025-01-15T00:54:53.022ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
102642025-01-15T00:54:53.022ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102652025-01-15T00:54:53.022ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ec8656df-732e-4409-b421-e68d3167e027", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
102662025-01-15T00:54:53.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102672025-01-15T00:54:53.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102682025-01-15T00:54:53.023ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102692025-01-15T00:54:53.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102702025-01-15T00:54:53.024ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
102712025-01-15T00:54:53.024ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 420.753948ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
102722025-01-15T00:54:53.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102732025-01-15T00:54:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102742025-01-15T00:54:53.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102752025-01-15T00:54:53.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102762025-01-15T00:54:53.031ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102772025-01-15T00:54:53.031ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102782025-01-15T00:54:53.031ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f275b7df-81a0-45aa-96f9-f3b0267f38bd", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
102792025-01-15T00:54:53.033ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 425.784644ms iteration = 21 status = {}
102802025-01-15T00:54:53.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102812025-01-15T00:54:53.035ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 87544e3f-558e-49c4-a575-93fad3f8d8fd file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
102822025-01-15T00:54:53.035ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
102832025-01-15T00:54:53.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
102842025-01-15T00:54:53.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
102852025-01-15T00:54:53.037ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102862025-01-15T00:54:53.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102872025-01-15T00:54:53.039ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 435.214415ms iteration = 21 status = 0
102882025-01-15T00:54:53.054ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102892025-01-15T00:54:53.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102902025-01-15T00:54:53.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102912025-01-15T00:54:53.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102922025-01-15T00:54:53.055ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102932025-01-15T00:54:53.056ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
102942025-01-15T00:54:53.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102952025-01-15T00:54:53.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102962025-01-15T00:54:53.059ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
102972025-01-15T00:54:53.059ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
102982025-01-15T00:54:53.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
102992025-01-15T00:54:53.063ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103002025-01-15T00:54:53.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103012025-01-15T00:54:53.065ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103022025-01-15T00:54:53.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103032025-01-15T00:54:53.066ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103042025-01-15T00:54:53.066ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103052025-01-15T00:54:53.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103062025-01-15T00:54:53.067ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0cdfb43-2131-45f1-8e90-fa8e516a0fbe", "content-length": "134", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
103072025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103082025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
103092025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103102025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103112025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103122025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103132025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103142025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103152025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103162025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103172025-01-15T00:54:53.067ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
103182025-01-15T00:54:53.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103192025-01-15T00:54:53.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103202025-01-15T00:54:53.068ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103212025-01-15T00:54:53.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103222025-01-15T00:54:53.070ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103232025-01-15T00:54:53.070ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1e482af-7585-48d7-a083-d40d10dbf803", "content-length": "2", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
103242025-01-15T00:54:53.070ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103252025-01-15T00:54:53.070ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "df2a81d8-4e4e-4bc1-8240-ae8496a43841", "content-length": "51", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
103262025-01-15T00:54:53.070ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
103272025-01-15T00:54:53.070ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103282025-01-15T00:54:53.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103292025-01-15T00:54:53.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103302025-01-15T00:54:53.075ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103312025-01-15T00:54:53.077ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103322025-01-15T00:54:53.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103332025-01-15T00:54:53.078ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103342025-01-15T00:54:53.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103352025-01-15T00:54:53.080ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103362025-01-15T00:54:53.083ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
103372025-01-15T00:54:53.083ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103382025-01-15T00:54:53.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103392025-01-15T00:54:53.084ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103402025-01-15T00:54:53.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103412025-01-15T00:54:53.086ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103422025-01-15T00:54:53.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103432025-01-15T00:54:53.087ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103442025-01-15T00:54:53.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
103452025-01-15T00:54:53.091ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103462025-01-15T00:54:53.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103472025-01-15T00:54:53.099ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
103482025-01-15T00:54:53.099ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103492025-01-15T00:54:53.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103502025-01-15T00:54:53.101ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103512025-01-15T00:54:53.103ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
103522025-01-15T00:54:53.103ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103532025-01-15T00:54:53.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103542025-01-15T00:54:53.104ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
103552025-01-15T00:54:53.104ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 7692e79e-ad5c-4ba6-a5ad-f46b874214cd, kind: Service { id: b51ac62e-be31-47f6-aa1e-af03a1941a9c }, name: Name("external-dns-b51ac62e-be31-47f6-aa1e-af03a1941a9c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 13])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d692e748-3939-4bf2-a8e5-712d64d9ffdb, kind: Service { id: 428f96bb-3527-41ae-b455-13a78e2ab5fa }, name: Name("external-dns-428f96bb-3527-41ae-b455-13a78e2ab5fa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 217, 118])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 11154b50-6a53-40c7-ab94-0ff2b7221be0, kind: Service { id: 72fbdda4-ce05-4dc2-9f16-1272a893088c }, name: Name("nexus-72fbdda4-ce05-4dc2-9f16-1272a893088c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 79])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 1d5cff3b-b000-4308-b096-1dcef3a1f63c, kind: Service { id: 1b0c7acf-5911-4566-8fa4-6d93171259ea }, name: Name("nexus-1b0c7acf-5911-4566-8fa4-6d93171259ea"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 60])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8b3478aa-815d-4a45-81c6-4e2aff024298, kind: Service { id: 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85 }, name: Name("nexus-37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 129, 134])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
103562025-01-15T00:54:53.104ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
103572025-01-15T00:54:53.171ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b2769d9e-be17-4dd6-a7e1-fcd6efb706a6", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
103582025-01-15T00:54:53.171ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
103592025-01-15T00:54:53.171ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
103602025-01-15T00:54:53.172ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8858fcdb-88c8-4ed8-84f1-9839fe9b15c5", "content-length": "691", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
103612025-01-15T00:54:53.172ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
103622025-01-15T00:54:53.172ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
103632025-01-15T00:54:53.172ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
103642025-01-15T00:54:53.172ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e53ec4a-60e6-4cc8-85af-1f161b577a19", "content-length": "682", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
103652025-01-15T00:54:53.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103662025-01-15T00:54:53.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103672025-01-15T00:54:53.173ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 566.118865ms iteration = 21 status = {}
103682025-01-15T00:54:53.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103692025-01-15T00:54:53.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103702025-01-15T00:54:53.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103712025-01-15T00:54:53.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103722025-01-15T00:54:53.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103732025-01-15T00:54:53.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103742025-01-15T00:54:53.190ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 586.272223ms iteration = 21 status = {}
103752025-01-15T00:54:53.211ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, time_created: 2025-01-15T00:45:37.185922Z, time_modified: 2025-01-15T00:45:37.185922Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
103762025-01-15T00:54:53.211ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
103772025-01-15T00:54:53.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103782025-01-15T00:54:53.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103792025-01-15T00:54:53.213ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
103802025-01-15T00:54:53.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
103812025-01-15T00:54:53.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103822025-01-15T00:54:53.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
103832025-01-15T00:54:53.218ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(0d996814-c4e0-4169-8678-851e25226ae7, 0), (79961366-6ae3-4f37-b55e-b71a716d5cf5, 0), (2337e2c7-288f-4524-b574-9076b1581db9, 0), (42cdce79-1b37-43ab-80b8-99a4a371e701, 0)] collection_id = 0d996814-c4e0-4169-8678-851e25226ae7
103842025-01-15T00:54:53.218ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103852025-01-15T00:54:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103862025-01-15T00:54:53.250ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
103872025-01-15T00:54:53.251ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "0f9b2103-1296-40c9-8d22-73d2c1a38ca6", "date": "Wed, 15 Jan 2025 00:54:52 GMT"} })
103882025-01-15T00:54:53.252ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
103892025-01-15T00:54:53.252ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 644.738758ms
103902025-01-15T00:54:53.252ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 644.747638ms iteration = 3 status = {}
103912025-01-15T00:54:53.278ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 0d996814-c4e0-4169-8678-851e25226ae7 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 84 nerrors = 0 nnics = 6 nnvme_disk_firmware = 11 nphysical_disks = 11 nrot_pages = 8 nrots = 2 nsled_agent_zones = 1 nsled_agents = 1 nsps = 2 nzones = 28 nzpools = 9
103922025-01-15T00:54:53.279ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
103932025-01-15T00:54:53.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
103942025-01-15T00:54:53.282ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(79961366-6ae3-4f37-b55e-b71a716d5cf5, 0), (2337e2c7-288f-4524-b574-9076b1581db9, 0), (42cdce79-1b37-43ab-80b8-99a4a371e701, 0)]
103952025-01-15T00:54:53.283ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1513, tv_nsec: 613265498 } })
103962025-01-15T00:54:53.318ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
103972025-01-15T00:54:53.318ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
103982025-01-15T00:54:53.318ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
103992025-01-15T00:54:53.318ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fd1afa1-6953-43f2-a18f-0add705913c4", "content-length": "476", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104002025-01-15T00:54:53.318ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
104012025-01-15T00:54:53.318ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "70b376f6-ea01-48f6-9be0-2b4248fb6166", "content-length": "734", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104022025-01-15T00:54:53.318ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
104032025-01-15T00:54:53.319ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bad43a29-0bfe-46c3-9c05-31b5f7b75407", "content-length": "111", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104042025-01-15T00:54:53.319ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
104052025-01-15T00:54:53.319ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1051c22-3d3a-4b78-9c49-b98551ae80cf", "content-length": "111", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104062025-01-15T00:54:53.319ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
104072025-01-15T00:54:53.319ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b713b8c-3774-4e21-a4a1-0d3397d29659", "content-length": "167", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104082025-01-15T00:54:53.319ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
104092025-01-15T00:54:53.319ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ac241b2-468a-40fa-b6ec-59e573f5a521", "content-length": "167", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104102025-01-15T00:54:53.319ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
104112025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "819e134a-6c32-427c-a9da-4b5bcbc4708e", "content-length": "175", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104122025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
104132025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cdadf05-194c-446b-ae9a-ea4aa77f0851", "content-length": "175", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104142025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
104152025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba998e1d-3e9b-4626-82b9-b4a7f4633f79", "content-length": "702", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104162025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
104172025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae58552f-cd7d-4b51-91f0-b9ce9fe9d6e2", "content-length": "727", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104182025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
104192025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "04486422-1d89-4e74-9c43-9a31bcd5f553", "content-length": "729", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104202025-01-15T00:54:53.320ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
104212025-01-15T00:54:53.321ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "984dff3d-e327-4359-93ed-9e1a93e0d3b2", "content-length": "728", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104222025-01-15T00:54:53.321ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
104232025-01-15T00:54:53.321ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4fd6316-441c-4df2-a6d7-3ac9ca1de124", "content-length": "722", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104242025-01-15T00:54:53.321ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
104252025-01-15T00:54:53.321ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c92913b7-fc06-48a2-b7bb-4bf3002c41dd", "content-length": "109", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104262025-01-15T00:54:53.321ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
104272025-01-15T00:54:53.321ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "03da56f1-31db-4ef3-b0a7-4de023200753", "content-length": "109", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104282025-01-15T00:54:53.321ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
104292025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2d24b57-905d-4acc-bece-c97ab445d349", "content-length": "169", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104302025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
104312025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "db0a4eb5-d91a-4152-af6d-aabdf1c46d19", "content-length": "169", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104322025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
104332025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1113e2e0-6821-493d-ad19-11e606ee446f", "content-length": "178", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104342025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
104352025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c0cb47cf-37a5-415e-895f-d294103c0eb2", "content-length": "178", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104362025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
104372025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd81c3b6-e2cf-4ec0-b93a-1d0f2efe48c6", "content-length": "702", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104382025-01-15T00:54:53.322ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
104392025-01-15T00:54:53.323ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c729cb6b-790e-48a3-8f6c-60bec6bc79f5", "content-length": "727", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104402025-01-15T00:54:53.323ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
104412025-01-15T00:54:53.323ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9413229d-1597-49cd-ad43-0483e8d9e5ae", "content-length": "729", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104422025-01-15T00:54:53.323ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
104432025-01-15T00:54:53.323ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e552fd64-3640-4cde-9c1f-e0c10ab2ec99", "content-length": "728", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104442025-01-15T00:54:53.323ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
104452025-01-15T00:54:53.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
104462025-01-15T00:54:53.325ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104472025-01-15T00:54:53.327ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
104482025-01-15T00:54:53.327ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
104492025-01-15T00:54:53.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
104502025-01-15T00:54:53.328ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104512025-01-15T00:54:53.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
104522025-01-15T00:54:53.330ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
104532025-01-15T00:54:53.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
104542025-01-15T00:54:53.424ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
104552025-01-15T00:54:53.424ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
104562025-01-15T00:54:53.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5da57fd0-c6e7-48c7-8ee4-8b2607c1176f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104572025-01-15T00:54:53.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5da57fd0-c6e7-48c7-8ee4-8b2607c1176f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104582025-01-15T00:54:53.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5da57fd0-c6e7-48c7-8ee4-8b2607c1176f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104592025-01-15T00:54:53.627ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb4d93a3-2b39-44b2-bd4b-77dffe52bc44", "content-length": "30798", "date": "Wed, 15 Jan 2025 00:54:53 GMT"} })
104602025-01-15T00:54:53.629ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
104612025-01-15T00:54:53.629ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
104622025-01-15T00:54:53.629ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
104632025-01-15T00:54:53.631ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
104642025-01-15T00:54:53.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
104652025-01-15T00:54:53.633ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104662025-01-15T00:54:53.635ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
104672025-01-15T00:54:53.635ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
104682025-01-15T00:54:53.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
104692025-01-15T00:54:53.805ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 1ceadde7-3e24-4f15-bde9-0df66f8e862d file = nexus/db-queries/src/db/datastore/inventory.rs:1010
104702025-01-15T00:54:53.805ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 1ceadde7-3e24-4f15-bde9-0df66f8e862d time_started = 2025-01-15 00:54:53.318090 UTC
104712025-01-15T00:54:53.805ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.200645187s iteration = 3 status = {"collection_id":"1ceadde7-3e24-4f15-bde9-0df66f8e862d","time_done":"2025-01-15 00:54:53.629665 UTC","time_started":"2025-01-15 00:54:53.318090 UTC"}
104722025-01-15T00:54:53.805ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
104732025-01-15T00:54:53.805ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104742025-01-15T00:54:53.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104752025-01-15T00:54:53.807ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104762025-01-15T00:54:53.808ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104772025-01-15T00:54:53.808ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104782025-01-15T00:54:53.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104792025-01-15T00:54:53.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104802025-01-15T00:54:53.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104812025-01-15T00:54:53.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104822025-01-15T00:54:53.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104832025-01-15T00:54:53.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104842025-01-15T00:54:53.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104852025-01-15T00:54:53.853ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 48.797219ms iteration = 24 status = {"physical_disks_added":0}
104862025-01-15T00:54:54.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 563 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 389d9e77-e4e7-4e47-a3ea-b8d985b9cf57 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
104872025-01-15T00:54:54.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 54b285b4-a98e-46e4-8cc2-6ef19145309e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104882025-01-15T00:54:54.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 54b285b4-a98e-46e4-8cc2-6ef19145309e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104892025-01-15T00:54:54.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2292 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 54b285b4-a98e-46e4-8cc2-6ef19145309e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104902025-01-15T00:54:55.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3eb43325-384c-4948-a830-ca8fcaecfc9c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104912025-01-15T00:54:55.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3eb43325-384c-4948-a830-ca8fcaecfc9c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104922025-01-15T00:54:55.588ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2877 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3eb43325-384c-4948-a830-ca8fcaecfc9c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104932025-01-15T00:54:56.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25041d0e-84f1-4b4d-9e16-16eb028897fb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104942025-01-15T00:54:56.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25041d0e-84f1-4b4d-9e16-16eb028897fb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104952025-01-15T00:54:56.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2127 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25041d0e-84f1-4b4d-9e16-16eb028897fb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104962025-01-15T00:54:57.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b159bd7-d8c6-4a7d-a8b3-9b3c5e5fa9f9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104972025-01-15T00:54:57.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b159bd7-d8c6-4a7d-a8b3-9b3c5e5fa9f9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104982025-01-15T00:54:57.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2366 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b159bd7-d8c6-4a7d-a8b3-9b3c5e5fa9f9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
104992025-01-15T00:54:58.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 513081b4-a14c-4197-b231-a3103ac758f1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105002025-01-15T00:54:58.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 513081b4-a14c-4197-b231-a3103ac758f1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105012025-01-15T00:54:58.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 513081b4-a14c-4197-b231-a3103ac758f1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105022025-01-15T00:54:59.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 899c12fd-abff-4bae-948a-52302e4fe401 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105032025-01-15T00:54:59.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 899c12fd-abff-4bae-948a-52302e4fe401 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105042025-01-15T00:54:59.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 899c12fd-abff-4bae-948a-52302e4fe401 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105052025-01-15T00:55:00.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c2eafcef-cb7e-4c69-b11c-46a1526b0cd5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105062025-01-15T00:55:00.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c2eafcef-cb7e-4c69-b11c-46a1526b0cd5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105072025-01-15T00:55:00.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c2eafcef-cb7e-4c69-b11c-46a1526b0cd5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105082025-01-15T00:55:01.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a3bec41-315f-4535-bbb0-dd8a9c72423d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105092025-01-15T00:55:01.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a3bec41-315f-4535-bbb0-dd8a9c72423d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105102025-01-15T00:55:01.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a3bec41-315f-4535-bbb0-dd8a9c72423d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105112025-01-15T00:55:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
105122025-01-15T00:55:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105132025-01-15T00:55:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105142025-01-15T00:55:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105152025-01-15T00:55:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105162025-01-15T00:55:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105172025-01-15T00:55:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105182025-01-15T00:55:02.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
105192025-01-15T00:55:02.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105202025-01-15T00:55:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105212025-01-15T00:55:02.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105222025-01-15T00:55:02.610ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105232025-01-15T00:55:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105242025-01-15T00:55:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105252025-01-15T00:55:02.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105262025-01-15T00:55:02.612ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.216621ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105272025-01-15T00:55:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
105282025-01-15T00:55:02.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105292025-01-15T00:55:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105302025-01-15T00:55:02.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
105312025-01-15T00:55:02.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.401521ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
105322025-01-15T00:55:02.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 482117c3-7fff-4e3f-938f-1f6ba0cc5247 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105332025-01-15T00:55:02.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 482117c3-7fff-4e3f-938f-1f6ba0cc5247 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105342025-01-15T00:55:02.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1632 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 482117c3-7fff-4e3f-938f-1f6ba0cc5247 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105352025-01-15T00:55:03.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a71cf3f-c611-4e1a-8aeb-f92cd7499939 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105362025-01-15T00:55:03.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a71cf3f-c611-4e1a-8aeb-f92cd7499939 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105372025-01-15T00:55:03.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a71cf3f-c611-4e1a-8aeb-f92cd7499939 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105382025-01-15T00:55:04.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 42736c43-8f24-4afb-b316-bacec1e6a22c roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
105392025-01-15T00:55:04.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 42736c43-8f24-4afb-b316-bacec1e6a22c resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
105402025-01-15T00:55:04.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 42736c43-8f24-4afb-b316-bacec1e6a22c response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
105412025-01-15T00:55:04.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = ff732cae-42cd-4b76-979a-b472ca20acef roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
105422025-01-15T00:55:04.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = ff732cae-42cd-4b76-979a-b472ca20acef resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
105432025-01-15T00:55:04.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = ff732cae-42cd-4b76-979a-b472ca20acef response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
105442025-01-15T00:55:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 5b45d2b1-6236-4c47-9b86-040ad33d09d4 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
105452025-01-15T00:55:04.779ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dd6267b9-4d45-497e-803f-d3286a0f8f07 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105462025-01-15T00:55:04.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dd6267b9-4d45-497e-803f-d3286a0f8f07 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105472025-01-15T00:55:04.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dd6267b9-4d45-497e-803f-d3286a0f8f07 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105482025-01-15T00:55:05.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 279087dc-b0bc-4da8-88d4-fa5463ca9073 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105492025-01-15T00:55:05.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 279087dc-b0bc-4da8-88d4-fa5463ca9073 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105502025-01-15T00:55:05.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1826 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 279087dc-b0bc-4da8-88d4-fa5463ca9073 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105512025-01-15T00:55:06.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2dbe113d-8575-4fe1-9303-16175b5cc493 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105522025-01-15T00:55:06.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2dbe113d-8575-4fe1-9303-16175b5cc493 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105532025-01-15T00:55:06.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2427 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2dbe113d-8575-4fe1-9303-16175b5cc493 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105542025-01-15T00:55:07.843ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88a03783-bf78-4e98-9935-7273063e2eb9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105552025-01-15T00:55:07.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88a03783-bf78-4e98-9935-7273063e2eb9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105562025-01-15T00:55:07.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88a03783-bf78-4e98-9935-7273063e2eb9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105572025-01-15T00:55:08.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c135012d-695e-4607-8e81-2985885603d9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105582025-01-15T00:55:08.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c135012d-695e-4607-8e81-2985885603d9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105592025-01-15T00:55:08.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c135012d-695e-4607-8e81-2985885603d9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105602025-01-15T00:55:09.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2296c01e-8c6f-4034-828f-76d4cf92240a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105612025-01-15T00:55:09.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2296c01e-8c6f-4034-828f-76d4cf92240a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105622025-01-15T00:55:09.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2296c01e-8c6f-4034-828f-76d4cf92240a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105632025-01-15T00:55:10.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 861deb17-ef15-45a8-9d05-1e00f070aef4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105642025-01-15T00:55:10.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 861deb17-ef15-45a8-9d05-1e00f070aef4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105652025-01-15T00:55:10.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 861deb17-ef15-45a8-9d05-1e00f070aef4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105662025-01-15T00:55:11.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ecd58eaa-a936-4679-8ef3-b1538d17b8eb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105672025-01-15T00:55:11.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ecd58eaa-a936-4679-8ef3-b1538d17b8eb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105682025-01-15T00:55:11.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2742 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ecd58eaa-a936-4679-8ef3-b1538d17b8eb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105692025-01-15T00:55:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
105702025-01-15T00:55:12.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105712025-01-15T00:55:12.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105722025-01-15T00:55:12.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105732025-01-15T00:55:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105742025-01-15T00:55:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105752025-01-15T00:55:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105762025-01-15T00:55:12.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
105772025-01-15T00:55:12.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105782025-01-15T00:55:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105792025-01-15T00:55:12.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105802025-01-15T00:55:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105812025-01-15T00:55:12.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105822025-01-15T00:55:12.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
105832025-01-15T00:55:12.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105842025-01-15T00:55:12.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105852025-01-15T00:55:12.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
105862025-01-15T00:55:12.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.388761ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
105872025-01-15T00:55:12.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105882025-01-15T00:55:12.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105892025-01-15T00:55:12.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.900756ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105902025-01-15T00:55:12.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d068180-03da-4e82-a938-d3c013497a63 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105912025-01-15T00:55:12.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d068180-03da-4e82-a938-d3c013497a63 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105922025-01-15T00:55:12.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2d068180-03da-4e82-a938-d3c013497a63 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105932025-01-15T00:55:13.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ad55a760-c6a4-49b5-9825-19cea89f8c65 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105942025-01-15T00:55:13.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ad55a760-c6a4-49b5-9825-19cea89f8c65 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105952025-01-15T00:55:13.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ad55a760-c6a4-49b5-9825-19cea89f8c65 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105962025-01-15T00:55:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 520 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = df8e3c00-3b41-42f4-8afd-06a84054e105 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
105972025-01-15T00:55:14.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6598ca5e-3eae-4697-bbf2-15c49d2451e5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105982025-01-15T00:55:14.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6598ca5e-3eae-4697-bbf2-15c49d2451e5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
105992025-01-15T00:55:15.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6598ca5e-3eae-4697-bbf2-15c49d2451e5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106002025-01-15T00:55:16.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff25746e-7d4f-4e3f-8be6-2a8928ef8cd4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106012025-01-15T00:55:16.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff25746e-7d4f-4e3f-8be6-2a8928ef8cd4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106022025-01-15T00:55:16.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ff25746e-7d4f-4e3f-8be6-2a8928ef8cd4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106032025-01-15T00:55:17.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1eeafa34-c0cd-4284-91cc-2e8ae565e56e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106042025-01-15T00:55:17.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1eeafa34-c0cd-4284-91cc-2e8ae565e56e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106052025-01-15T00:55:17.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2640 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1eeafa34-c0cd-4284-91cc-2e8ae565e56e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106062025-01-15T00:55:18.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3982ff9a-e696-4c06-93be-1038e8d94d96 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106072025-01-15T00:55:18.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3982ff9a-e696-4c06-93be-1038e8d94d96 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106082025-01-15T00:55:18.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3982ff9a-e696-4c06-93be-1038e8d94d96 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106092025-01-15T00:55:19.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46b19eda-a1ec-402d-9079-e0296ccdb275 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106102025-01-15T00:55:19.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46b19eda-a1ec-402d-9079-e0296ccdb275 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106112025-01-15T00:55:19.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46b19eda-a1ec-402d-9079-e0296ccdb275 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106122025-01-15T00:55:19.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 60b5fd31-9b79-499e-be2b-f5f699b19f78 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
106132025-01-15T00:55:19.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 60b5fd31-9b79-499e-be2b-f5f699b19f78 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
106142025-01-15T00:55:19.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3294 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 60b5fd31-9b79-499e-be2b-f5f699b19f78 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
106152025-01-15T00:55:19.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 9a2fa589-758c-4c9a-97e8-6f70e9a5a09f roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
106162025-01-15T00:55:19.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 9a2fa589-758c-4c9a-97e8-6f70e9a5a09f resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
106172025-01-15T00:55:19.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2571 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 9a2fa589-758c-4c9a-97e8-6f70e9a5a09f response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
106182025-01-15T00:55:20.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 30517340-7c4f-4dfc-a444-bbf457e84209 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106192025-01-15T00:55:20.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 30517340-7c4f-4dfc-a444-bbf457e84209 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106202025-01-15T00:55:20.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2245 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 30517340-7c4f-4dfc-a444-bbf457e84209 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106212025-01-15T00:55:21.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 47597135-5fbf-42c1-9a61-603a439c1bbb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106222025-01-15T00:55:21.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 47597135-5fbf-42c1-9a61-603a439c1bbb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106232025-01-15T00:55:21.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 47597135-5fbf-42c1-9a61-603a439c1bbb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106242025-01-15T00:55:22.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41de04c4-9d57-467f-a781-caca4d14c559 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106252025-01-15T00:55:22.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41de04c4-9d57-467f-a781-caca4d14c559 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106262025-01-15T00:55:22.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9800 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41de04c4-9d57-467f-a781-caca4d14c559 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
106272025-01-15T00:55:22.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
106282025-01-15T00:55:22.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
106292025-01-15T00:55:22.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
106302025-01-15T00:55:22.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
106312025-01-15T00:55:22.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106322025-01-15T00:55:22.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
106332025-01-15T00:55:22.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106342025-01-15T00:55:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
106352025-01-15T00:55:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106362025-01-15T00:55:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106372025-01-15T00:55:22.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
106382025-01-15T00:55:22.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
106392025-01-15T00:55:22.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106402025-01-15T00:55:22.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106412025-01-15T00:55:22.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
106422025-01-15T00:55:22.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106432025-01-15T00:55:22.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
106442025-01-15T00:55:22.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106452025-01-15T00:55:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106462025-01-15T00:55:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106472025-01-15T00:55:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106482025-01-15T00:55:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106492025-01-15T00:55:22.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106502025-01-15T00:55:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1542, tv_nsec: 935726629 } })
106512025-01-15T00:55:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1542, tv_nsec: 935821100 } })
106522025-01-15T00:55:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
106532025-01-15T00:55:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
106542025-01-15T00:55:22.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.893444ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106552025-01-15T00:55:22.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106562025-01-15T00:55:22.606ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106572025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106582025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106592025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
106602025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
106612025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106622025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106632025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
106642025-01-15T00:55:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
106652025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
106662025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
106672025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106682025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106692025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
106702025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106712025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
106722025-01-15T00:55:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106732025-01-15T00:55:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106742025-01-15T00:55:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106752025-01-15T00:55:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106762025-01-15T00:55:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106772025-01-15T00:55:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106782025-01-15T00:55:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106792025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106802025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106812025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
106822025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
106832025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106842025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
106852025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
106862025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106872025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
106882025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
106892025-01-15T00:55:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106902025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106912025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106922025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106932025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106942025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106952025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106962025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
106972025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106982025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106992025-01-15T00:55:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107002025-01-15T00:55:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107012025-01-15T00:55:22.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107022025-01-15T00:55:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107032025-01-15T00:55:22.611ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107042025-01-15T00:55:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
107052025-01-15T00:55:22.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107062025-01-15T00:55:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107072025-01-15T00:55:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
107082025-01-15T00:55:22.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107092025-01-15T00:55:22.613ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107102025-01-15T00:55:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107112025-01-15T00:55:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107122025-01-15T00:55:22.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107132025-01-15T00:55:22.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107142025-01-15T00:55:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107152025-01-15T00:55:22.615ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.211591ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
107162025-01-15T00:55:22.615ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107172025-01-15T00:55:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107182025-01-15T00:55:22.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107192025-01-15T00:55:22.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107202025-01-15T00:55:22.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107212025-01-15T00:55:22.619ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1542, tv_nsec: 948934813 } })
107222025-01-15T00:55:22.619ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
107232025-01-15T00:55:22.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107242025-01-15T00:55:22.619ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107252025-01-15T00:55:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107262025-01-15T00:55:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107272025-01-15T00:55:22.620ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107282025-01-15T00:55:22.620ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.47979ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107292025-01-15T00:55:22.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107302025-01-15T00:55:22.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107312025-01-15T00:55:22.621ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107322025-01-15T00:55:22.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107332025-01-15T00:55:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
107342025-01-15T00:55:22.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107352025-01-15T00:55:22.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107362025-01-15T00:55:22.627ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107372025-01-15T00:55:22.628ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 18.407564ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
107382025-01-15T00:55:22.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107392025-01-15T00:55:22.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107402025-01-15T00:55:22.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107412025-01-15T00:55:22.643ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
107422025-01-15T00:55:22.643ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.960419ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
107432025-01-15T00:55:22.651ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107442025-01-15T00:55:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107452025-01-15T00:55:22.652ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107462025-01-15T00:55:22.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.815914ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
107472025-01-15T00:55:22.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107482025-01-15T00:55:22.652ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107492025-01-15T00:55:22.652ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107502025-01-15T00:55:22.652ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107512025-01-15T00:55:22.653ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107522025-01-15T00:55:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107532025-01-15T00:55:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107542025-01-15T00:55:22.653ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107552025-01-15T00:55:22.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107562025-01-15T00:55:22.655ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 46.169429ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107572025-01-15T00:55:22.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107582025-01-15T00:55:22.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107592025-01-15T00:55:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
107602025-01-15T00:55:22.657ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107612025-01-15T00:55:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107622025-01-15T00:55:22.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107632025-01-15T00:55:22.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107642025-01-15T00:55:22.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107652025-01-15T00:55:22.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107662025-01-15T00:55:22.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107672025-01-15T00:55:22.662ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107682025-01-15T00:55:22.665ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107692025-01-15T00:55:22.665ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 57.464836ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107702025-01-15T00:55:22.666ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
107712025-01-15T00:55:22.666ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107722025-01-15T00:55:22.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107732025-01-15T00:55:22.671ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.03132ms iteration = 22 status = 0
107742025-01-15T00:55:22.676ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 71.848452ms iteration = 25 status = {"physical_disks_added":0}
107752025-01-15T00:55:22.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.646974ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107762025-01-15T00:55:22.691ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107772025-01-15T00:55:22.692ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107782025-01-15T00:55:22.692ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107792025-01-15T00:55:22.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107802025-01-15T00:55:22.695ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
107812025-01-15T00:55:22.695ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107822025-01-15T00:55:22.696ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc13a57e-6975-4871-8fdd-1d71bda7168d", "content-length": "26", "date": "Wed, 15 Jan 2025 00:55:21 GMT"} })
107832025-01-15T00:55:22.696ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107842025-01-15T00:55:22.696ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
107852025-01-15T00:55:22.696ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 91.774617ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
107862025-01-15T00:55:22.697ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107872025-01-15T00:55:22.724ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107882025-01-15T00:55:22.724ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107892025-01-15T00:55:22.724ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 116.675335ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107902025-01-15T00:55:22.754ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107912025-01-15T00:55:22.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107922025-01-15T00:55:22.806ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
107932025-01-15T00:55:22.806ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107942025-01-15T00:55:22.806ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b4a4ff0-7702-492b-9847-8a1bcecd20a6", "content-length": "26", "date": "Wed, 15 Jan 2025 00:55:21 GMT"} })
107952025-01-15T00:55:22.806ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107962025-01-15T00:55:22.808ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107972025-01-15T00:55:22.811ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
107982025-01-15T00:55:22.811ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1a2bf4a-8afc-4519-9c7c-9f4398059df7", "content-length": "1", "date": "Wed, 15 Jan 2025 00:55:22 GMT"} })
107992025-01-15T00:55:22.813ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108002025-01-15T00:55:22.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108012025-01-15T00:55:22.814ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
108022025-01-15T00:55:22.814ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108032025-01-15T00:55:22.815ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83822a0e-c536-4112-a279-9426c7846e24", "content-length": "26", "date": "Wed, 15 Jan 2025 00:55:21 GMT"} })
108042025-01-15T00:55:22.815ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108052025-01-15T00:55:22.816ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
108062025-01-15T00:55:22.868ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108072025-01-15T00:55:22.868ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108082025-01-15T00:55:22.869ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b36244f6-3616-48aa-92ce-c385544f9577", "content-length": "372", "date": "Wed, 15 Jan 2025 00:55:21 GMT"} })
108092025-01-15T00:55:22.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108102025-01-15T00:55:22.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108112025-01-15T00:55:22.870ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108122025-01-15T00:55:22.871ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 268.939316ms iteration = 22 status = null
108132025-01-15T00:55:22.872ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108142025-01-15T00:55:22.872ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108152025-01-15T00:55:22.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108162025-01-15T00:55:22.902ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108172025-01-15T00:55:22.904ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108182025-01-15T00:55:22.904ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108192025-01-15T00:55:22.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108202025-01-15T00:55:22.909ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 306.644321ms iteration = 22 status = {}
108212025-01-15T00:55:22.914ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
108222025-01-15T00:55:22.914ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108232025-01-15T00:55:22.914ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ee951660-76a8-4251-bd10-3b8b753d39aa", "date": "Wed, 15 Jan 2025 00:55:21 GMT"} })
108242025-01-15T00:55:22.914ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108252025-01-15T00:55:22.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108262025-01-15T00:55:22.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108272025-01-15T00:55:22.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108282025-01-15T00:55:22.920ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108292025-01-15T00:55:22.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108302025-01-15T00:55:22.923ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
108312025-01-15T00:55:22.923ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108322025-01-15T00:55:22.924ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bdd18066-db1f-4931-9cd1-810dffe7e7ce", "date": "Wed, 15 Jan 2025 00:55:21 GMT"} })
108332025-01-15T00:55:22.925ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.940429ms iteration = 22 status = {}
108342025-01-15T00:55:22.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108352025-01-15T00:55:22.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108362025-01-15T00:55:22.966ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
108372025-01-15T00:55:22.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108382025-01-15T00:55:22.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108392025-01-15T00:55:22.977ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
108402025-01-15T00:55:22.977ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "69cb8390-587f-4207-ac7e-4c6d8be15b88", "content-length": "134", "date": "Wed, 15 Jan 2025 00:55:22 GMT"} })
108412025-01-15T00:55:22.977ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
108422025-01-15T00:55:22.977ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
108432025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
108442025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
108452025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108462025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108472025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108482025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108492025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108502025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108512025-01-15T00:55:22.978ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
108522025-01-15T00:55:22.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108532025-01-15T00:55:22.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108542025-01-15T00:55:22.995ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
108552025-01-15T00:55:22.995ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df690626-d761-4490-bdbc-15e483dd55ca", "content-length": "691", "date": "Wed, 15 Jan 2025 00:55:22 GMT"} })
108562025-01-15T00:55:22.995ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
108572025-01-15T00:55:22.995ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
108582025-01-15T00:55:22.995ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
108592025-01-15T00:55:22.996ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
108602025-01-15T00:55:22.996ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f61cc59-87df-4ece-a348-af1d04143ae9", "content-length": "2", "date": "Wed, 15 Jan 2025 00:55:22 GMT"} })
108612025-01-15T00:55:22.996ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
108622025-01-15T00:55:22.996ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "68f22bc4-3e32-4537-8f9e-f7cc751e9abe", "content-length": "51", "date": "Wed, 15 Jan 2025 00:55:22 GMT"} })
108632025-01-15T00:55:22.996ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
108642025-01-15T00:55:22.996ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
108652025-01-15T00:55:22.996ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 389.17206ms iteration = 22 status = {}
108662025-01-15T00:55:23.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = b6b93bd6-1d66-450b-a711-b5f6390412e5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
108672025-01-15T00:55:23.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = b6b93bd6-1d66-450b-a711-b5f6390412e5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
108682025-01-15T00:55:23.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3392 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = b6b93bd6-1d66-450b-a711-b5f6390412e5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
108692025-01-15T00:55:23.089ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0a217011-475a-4f94-b4c7-ab4bedcee66d", "date": "Wed, 15 Jan 2025 00:55:22 GMT"} })
108702025-01-15T00:55:23.089ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
108712025-01-15T00:55:23.089ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
108722025-01-15T00:55:23.089ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "df77c9a9-5c14-49fc-ab17-20c73ce0730d", "content-length": "682", "date": "Wed, 15 Jan 2025 00:55:22 GMT"} })
108732025-01-15T00:55:23.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108742025-01-15T00:55:23.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108752025-01-15T00:55:23.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108762025-01-15T00:55:23.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108772025-01-15T00:55:23.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108782025-01-15T00:55:23.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108792025-01-15T00:55:23.098ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108802025-01-15T00:55:23.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108812025-01-15T00:55:23.105ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 500.480012ms iteration = 22 status = {}
108822025-01-15T00:55:23.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25946cb1-011b-4d3f-b54d-b1c3be6fb226 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108832025-01-15T00:55:23.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25946cb1-011b-4d3f-b54d-b1c3be6fb226 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108842025-01-15T00:55:23.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 25946cb1-011b-4d3f-b54d-b1c3be6fb226 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108852025-01-15T00:55:24.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f36e3bd7-07a5-49ab-839d-208339877e1e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108862025-01-15T00:55:24.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f36e3bd7-07a5-49ab-839d-208339877e1e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108872025-01-15T00:55:24.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f36e3bd7-07a5-49ab-839d-208339877e1e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108882025-01-15T00:55:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 518 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 20bf7d15-93e8-4f72-afe6-0f18ee65a5b7 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
108892025-01-15T00:55:25.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62881b23-f32d-4c7a-b848-2cfe9111598a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108902025-01-15T00:55:25.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62881b23-f32d-4c7a-b848-2cfe9111598a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108912025-01-15T00:55:25.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 62881b23-f32d-4c7a-b848-2cfe9111598a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108922025-01-15T00:55:26.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f866e88c-761b-4cca-9ced-12a2446fb3e4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108932025-01-15T00:55:26.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f866e88c-761b-4cca-9ced-12a2446fb3e4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108942025-01-15T00:55:26.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2105 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f866e88c-761b-4cca-9ced-12a2446fb3e4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108952025-01-15T00:55:27.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f5ea74a2-8906-4cee-bfd2-c7b49d311ef5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108962025-01-15T00:55:27.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f5ea74a2-8906-4cee-bfd2-c7b49d311ef5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108972025-01-15T00:55:27.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2759 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f5ea74a2-8906-4cee-bfd2-c7b49d311ef5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108982025-01-15T00:55:28.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0aea55c2-c91a-4fbf-99e7-10b6bcaf3629 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
108992025-01-15T00:55:28.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0aea55c2-c91a-4fbf-99e7-10b6bcaf3629 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109002025-01-15T00:55:28.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1717 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0aea55c2-c91a-4fbf-99e7-10b6bcaf3629 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109012025-01-15T00:55:29.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 28f9ff14-af7e-43c6-badd-6cf32c580bd4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109022025-01-15T00:55:29.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 28f9ff14-af7e-43c6-badd-6cf32c580bd4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109032025-01-15T00:55:29.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4979 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 28f9ff14-af7e-43c6-badd-6cf32c580bd4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109042025-01-15T00:55:30.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8c7da062-9a6b-42f6-b0d6-7d1a5efe4e2b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109052025-01-15T00:55:30.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8c7da062-9a6b-42f6-b0d6-7d1a5efe4e2b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109062025-01-15T00:55:30.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8c7da062-9a6b-42f6-b0d6-7d1a5efe4e2b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109072025-01-15T00:55:31.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 13eafeb3-71e1-4d86-ba83-9fa2c55e63cd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109082025-01-15T00:55:31.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 13eafeb3-71e1-4d86-ba83-9fa2c55e63cd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109092025-01-15T00:55:31.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1999 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 13eafeb3-71e1-4d86-ba83-9fa2c55e63cd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109102025-01-15T00:55:32.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fabb1310-36ca-474e-adb2-24f6f754eedd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109112025-01-15T00:55:32.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fabb1310-36ca-474e-adb2-24f6f754eedd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109122025-01-15T00:55:32.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fabb1310-36ca-474e-adb2-24f6f754eedd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109132025-01-15T00:55:32.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
109142025-01-15T00:55:32.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109152025-01-15T00:55:32.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109162025-01-15T00:55:32.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109172025-01-15T00:55:32.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109182025-01-15T00:55:32.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109192025-01-15T00:55:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109202025-01-15T00:55:32.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
109212025-01-15T00:55:32.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109222025-01-15T00:55:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109232025-01-15T00:55:32.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109242025-01-15T00:55:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109252025-01-15T00:55:32.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109262025-01-15T00:55:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109272025-01-15T00:55:32.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109282025-01-15T00:55:32.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
109292025-01-15T00:55:32.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109302025-01-15T00:55:32.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109312025-01-15T00:55:32.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
109322025-01-15T00:55:32.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.694527ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
109332025-01-15T00:55:32.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.983457ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109342025-01-15T00:55:33.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f4bd1ee0-5886-4ea8-b6a6-71085e9b7751 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109352025-01-15T00:55:33.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f4bd1ee0-5886-4ea8-b6a6-71085e9b7751 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109362025-01-15T00:55:33.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f4bd1ee0-5886-4ea8-b6a6-71085e9b7751 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109372025-01-15T00:55:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 537 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 475f5127-98c8-4b8c-b17d-7ef16026fe8f response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
109382025-01-15T00:55:34.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4065b96f-d0ca-4a5b-b75b-4722903786e9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109392025-01-15T00:55:34.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4065b96f-d0ca-4a5b-b75b-4722903786e9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109402025-01-15T00:55:34.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4065b96f-d0ca-4a5b-b75b-4722903786e9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109412025-01-15T00:55:35.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cef49479-bd19-41b2-afa9-2248114a322b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109422025-01-15T00:55:35.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cef49479-bd19-41b2-afa9-2248114a322b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109432025-01-15T00:55:35.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cef49479-bd19-41b2-afa9-2248114a322b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109442025-01-15T00:55:36.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 037df673-568e-4f63-b203-3e381e106651 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109452025-01-15T00:55:36.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 037df673-568e-4f63-b203-3e381e106651 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109462025-01-15T00:55:36.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 037df673-568e-4f63-b203-3e381e106651 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109472025-01-15T00:55:37.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5335b9e0-ab1d-4018-a90b-885717d204ea roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109482025-01-15T00:55:37.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5335b9e0-ab1d-4018-a90b-885717d204ea resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109492025-01-15T00:55:37.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5335b9e0-ab1d-4018-a90b-885717d204ea response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109502025-01-15T00:55:38.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2392594f-7072-4f17-93af-2f6010527b63 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109512025-01-15T00:55:38.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2392594f-7072-4f17-93af-2f6010527b63 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109522025-01-15T00:55:38.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1915 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2392594f-7072-4f17-93af-2f6010527b63 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109532025-01-15T00:55:39.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 796e66fd-db23-477c-8b13-bc0c590d0382 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109542025-01-15T00:55:39.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 796e66fd-db23-477c-8b13-bc0c590d0382 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109552025-01-15T00:55:39.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 796e66fd-db23-477c-8b13-bc0c590d0382 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109562025-01-15T00:55:40.547ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 92a687da-081c-4cb1-9b66-b8e01cb9394c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109572025-01-15T00:55:40.548ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 92a687da-081c-4cb1-9b66-b8e01cb9394c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109582025-01-15T00:55:40.549ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 92a687da-081c-4cb1-9b66-b8e01cb9394c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109592025-01-15T00:55:41.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 02fbeea3-152f-49cb-a1f3-46af88de3f6d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109602025-01-15T00:55:41.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 02fbeea3-152f-49cb-a1f3-46af88de3f6d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109612025-01-15T00:55:41.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4446 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 02fbeea3-152f-49cb-a1f3-46af88de3f6d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109622025-01-15T00:55:42.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e07941d9-ad56-4faa-a141-a47798ccbc70 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109632025-01-15T00:55:42.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e07941d9-ad56-4faa-a141-a47798ccbc70 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109642025-01-15T00:55:42.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e07941d9-ad56-4faa-a141-a47798ccbc70 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109652025-01-15T00:55:42.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
109662025-01-15T00:55:42.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109672025-01-15T00:55:42.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109682025-01-15T00:55:42.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109692025-01-15T00:55:42.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109702025-01-15T00:55:42.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109712025-01-15T00:55:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109722025-01-15T00:55:42.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
109732025-01-15T00:55:42.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109742025-01-15T00:55:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109752025-01-15T00:55:42.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109762025-01-15T00:55:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109772025-01-15T00:55:42.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109782025-01-15T00:55:42.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109792025-01-15T00:55:42.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109802025-01-15T00:55:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
109812025-01-15T00:55:42.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109822025-01-15T00:55:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109832025-01-15T00:55:42.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
109842025-01-15T00:55:42.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.86722ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
109852025-01-15T00:55:42.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.812313ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109862025-01-15T00:55:43.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a734dbe2-e4a5-4077-9bcc-2ed8cbf09f73 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109872025-01-15T00:55:43.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a734dbe2-e4a5-4077-9bcc-2ed8cbf09f73 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109882025-01-15T00:55:43.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a734dbe2-e4a5-4077-9bcc-2ed8cbf09f73 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109892025-01-15T00:55:44.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 547 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = f9b568ef-f8e0-49fd-b726-8992c696fb8e response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
109902025-01-15T00:55:44.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa63b26d-4305-440f-b50c-8aa529e53d00 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109912025-01-15T00:55:44.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa63b26d-4305-440f-b50c-8aa529e53d00 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109922025-01-15T00:55:44.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2328 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fa63b26d-4305-440f-b50c-8aa529e53d00 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109932025-01-15T00:55:45.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 901fd3d8-a3be-4304-942b-e482a87714c4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109942025-01-15T00:55:45.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 901fd3d8-a3be-4304-942b-e482a87714c4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109952025-01-15T00:55:45.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2335 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 901fd3d8-a3be-4304-942b-e482a87714c4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109962025-01-15T00:55:46.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6cde9d19-dada-4d73-a23d-19120d175b34 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109972025-01-15T00:55:46.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6cde9d19-dada-4d73-a23d-19120d175b34 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109982025-01-15T00:55:46.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6cde9d19-dada-4d73-a23d-19120d175b34 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
109992025-01-15T00:55:47.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6530b048-cafe-4708-b963-3fe71299c185 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110002025-01-15T00:55:47.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6530b048-cafe-4708-b963-3fe71299c185 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110012025-01-15T00:55:47.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2298 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6530b048-cafe-4708-b963-3fe71299c185 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110022025-01-15T00:55:48.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d64d9ac-cdce-4146-855a-9d78b8864aa7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110032025-01-15T00:55:48.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d64d9ac-cdce-4146-855a-9d78b8864aa7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110042025-01-15T00:55:48.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2051 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7d64d9ac-cdce-4146-855a-9d78b8864aa7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110052025-01-15T00:55:49.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = d893e347-5669-48f3-b3ef-9a5132921269 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
110062025-01-15T00:55:49.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = d893e347-5669-48f3-b3ef-9a5132921269 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
110072025-01-15T00:55:49.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = d893e347-5669-48f3-b3ef-9a5132921269 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
110082025-01-15T00:55:49.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c14b951b-8bd4-42eb-aae5-008a4143d018 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
110092025-01-15T00:55:49.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c14b951b-8bd4-42eb-aae5-008a4143d018 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
110102025-01-15T00:55:49.289ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2424 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = c14b951b-8bd4-42eb-aae5-008a4143d018 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
110112025-01-15T00:55:49.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c452a98-ae41-47f8-88fc-505078738b2e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110122025-01-15T00:55:49.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c452a98-ae41-47f8-88fc-505078738b2e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110132025-01-15T00:55:49.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1654 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4c452a98-ae41-47f8-88fc-505078738b2e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110142025-01-15T00:55:50.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 27946844-e786-496d-bee5-4b6f5b7ee276 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110152025-01-15T00:55:50.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 27946844-e786-496d-bee5-4b6f5b7ee276 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110162025-01-15T00:55:50.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2083 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 27946844-e786-496d-bee5-4b6f5b7ee276 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110172025-01-15T00:55:51.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f9e5110-ed51-4612-b0e5-cb020238d868 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110182025-01-15T00:55:51.788ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f9e5110-ed51-4612-b0e5-cb020238d868 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110192025-01-15T00:55:51.790ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9f9e5110-ed51-4612-b0e5-cb020238d868 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
110202025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
110212025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
110222025-01-15T00:55:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
110232025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.831\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
110242025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110252025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
110262025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
110272025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110282025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
110292025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
110302025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
110312025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
110322025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
110332025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
110342025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110352025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110362025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
110372025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
110382025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
110392025-01-15T00:55:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:45:52.603427196 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
110402025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110412025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
110422025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
110432025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
110442025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110452025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110462025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
110472025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110482025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
110492025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110502025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110512025-01-15T00:55:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110522025-01-15T00:55:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1572, tv_nsec: 933828522 } })
110532025-01-15T00:55:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1572, tv_nsec: 933848272 } })
110542025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
110552025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
110562025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
110572025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110582025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
110592025-01-15T00:55:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
110602025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110612025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
110622025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
110632025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110642025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110652025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
110662025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.120821ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
110672025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
110682025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.149352ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
110692025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
110702025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110712025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110722025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110732025-01-15T00:55:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110742025-01-15T00:55:52.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110752025-01-15T00:55:52.605ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110762025-01-15T00:55:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110772025-01-15T00:55:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110782025-01-15T00:55:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110792025-01-15T00:55:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1572, tv_nsec: 936937222 } })
110802025-01-15T00:55:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
110812025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.083908ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110822025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
110832025-01-15T00:55:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110842025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110852025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
110862025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110872025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
110882025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
110892025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110902025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110912025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
110922025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110932025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110942025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
110952025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
110962025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110972025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110982025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110992025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111002025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111012025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111022025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111032025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111042025-01-15T00:55:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111052025-01-15T00:55:52.608ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:45:52.603427196 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
111062025-01-15T00:55:52.608ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.68749ms iteration = 12 status = {"expiration":"2025-01-15T00:45:52.603427196Z","pruned":[]}
111072025-01-15T00:55:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111082025-01-15T00:55:52.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111092025-01-15T00:55:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111102025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
111112025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
111122025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
111132025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111142025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
111152025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111162025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
111172025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
111182025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
111192025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
111202025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
111212025-01-15T00:55:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
111222025-01-15T00:55:52.610ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111232025-01-15T00:55:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111242025-01-15T00:55:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
111252025-01-15T00:55:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
111262025-01-15T00:55:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
111272025-01-15T00:55:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111282025-01-15T00:55:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
111292025-01-15T00:55:52.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111302025-01-15T00:55:52.611ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1572, tv_nsec: 941159803 } })
111312025-01-15T00:55:52.611ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
111322025-01-15T00:55:52.611ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111332025-01-15T00:55:52.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111342025-01-15T00:55:52.612ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111352025-01-15T00:55:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111362025-01-15T00:55:52.613ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111372025-01-15T00:55:52.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111382025-01-15T00:55:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
111392025-01-15T00:55:52.614ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
111402025-01-15T00:55:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
111412025-01-15T00:55:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111422025-01-15T00:55:52.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111432025-01-15T00:55:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111442025-01-15T00:55:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111452025-01-15T00:55:52.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111462025-01-15T00:55:52.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111472025-01-15T00:55:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111482025-01-15T00:55:52.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111492025-01-15T00:55:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111502025-01-15T00:55:52.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111512025-01-15T00:55:52.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111522025-01-15T00:55:52.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111532025-01-15T00:55:52.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111542025-01-15T00:55:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111552025-01-15T00:55:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111562025-01-15T00:55:52.620ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111572025-01-15T00:55:52.621ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111582025-01-15T00:55:52.621ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111592025-01-15T00:55:52.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111602025-01-15T00:55:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111612025-01-15T00:55:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
111622025-01-15T00:55:52.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111632025-01-15T00:55:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111642025-01-15T00:55:52.625ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.13233ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
111652025-01-15T00:55:52.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111662025-01-15T00:55:52.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111672025-01-15T00:55:52.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111682025-01-15T00:55:52.629ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111692025-01-15T00:55:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111702025-01-15T00:55:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111712025-01-15T00:55:52.630ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1572, tv_nsec: 960314162 } })
111722025-01-15T00:55:52.630ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
111732025-01-15T00:55:52.631ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111742025-01-15T00:55:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
111752025-01-15T00:55:52.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111762025-01-15T00:55:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111772025-01-15T00:55:52.638ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111782025-01-15T00:55:52.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
111792025-01-15T00:55:52.643ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111802025-01-15T00:55:52.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111812025-01-15T00:55:52.644ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111822025-01-15T00:55:52.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111832025-01-15T00:55:52.652ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111842025-01-15T00:55:52.652ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
111852025-01-15T00:55:52.652ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
111862025-01-15T00:55:52.652ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
111872025-01-15T00:55:52.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111882025-01-15T00:55:52.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111892025-01-15T00:55:52.652ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111902025-01-15T00:55:52.655ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111912025-01-15T00:55:52.655ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111922025-01-15T00:55:52.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111932025-01-15T00:55:52.656ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
111942025-01-15T00:55:52.656ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111952025-01-15T00:55:52.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111962025-01-15T00:55:52.658ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111972025-01-15T00:55:52.658ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
111982025-01-15T00:55:52.658ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111992025-01-15T00:55:52.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112002025-01-15T00:55:52.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112012025-01-15T00:55:52.663ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112022025-01-15T00:55:52.663ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112032025-01-15T00:55:52.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112042025-01-15T00:55:52.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.300883ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
112052025-01-15T00:55:52.667ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112062025-01-15T00:55:52.667ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112072025-01-15T00:55:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112082025-01-15T00:55:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112092025-01-15T00:55:52.675ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
112102025-01-15T00:55:52.676ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
112112025-01-15T00:55:52.676ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 66.129642ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
112122025-01-15T00:55:52.677ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112132025-01-15T00:55:52.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112142025-01-15T00:55:52.679ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112152025-01-15T00:55:52.682ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112162025-01-15T00:55:52.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112172025-01-15T00:55:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112182025-01-15T00:55:52.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.478363ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
112192025-01-15T00:55:52.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 76.834619ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112202025-01-15T00:55:52.687ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
112212025-01-15T00:55:52.687ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.708354ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
112222025-01-15T00:55:52.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 78.007681ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112232025-01-15T00:55:52.688ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
112242025-01-15T00:55:52.688ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
112252025-01-15T00:55:52.688ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 84.037298ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
112262025-01-15T00:55:52.691ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112272025-01-15T00:55:52.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112282025-01-15T00:55:52.694ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
112292025-01-15T00:55:52.694ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.822578ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
112302025-01-15T00:55:52.695ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112312025-01-15T00:55:52.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112322025-01-15T00:55:52.698ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112332025-01-15T00:55:52.700ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
112342025-01-15T00:55:52.700ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112352025-01-15T00:55:52.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112362025-01-15T00:55:52.703ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 99.204019ms iteration = 23 status = 0
112372025-01-15T00:55:52.703ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
112382025-01-15T00:55:52.703ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
112392025-01-15T00:55:52.703ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
112402025-01-15T00:55:52.703ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112412025-01-15T00:55:52.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112422025-01-15T00:55:52.707ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.256789ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112432025-01-15T00:55:52.710ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112442025-01-15T00:55:52.710ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
112452025-01-15T00:55:52.710ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112462025-01-15T00:55:52.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112472025-01-15T00:55:52.712ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112482025-01-15T00:55:52.712ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112492025-01-15T00:55:52.712ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 105.421879ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112502025-01-15T00:55:52.713ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112512025-01-15T00:55:52.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112522025-01-15T00:55:52.715ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112532025-01-15T00:55:52.718ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
112542025-01-15T00:55:52.718ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112552025-01-15T00:55:52.718ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112562025-01-15T00:55:52.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
112572025-01-15T00:55:52.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112582025-01-15T00:55:52.720ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112592025-01-15T00:55:52.721ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
112602025-01-15T00:55:52.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
112612025-01-15T00:55:52.722ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
112622025-01-15T00:55:52.722ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
112632025-01-15T00:55:52.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
112642025-01-15T00:55:52.726ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112652025-01-15T00:55:52.726ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
112662025-01-15T00:55:52.726ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
112672025-01-15T00:55:52.726ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112682025-01-15T00:55:52.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112692025-01-15T00:55:52.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112702025-01-15T00:55:52.729ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112712025-01-15T00:55:52.732ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112722025-01-15T00:55:52.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112732025-01-15T00:55:52.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112742025-01-15T00:55:52.734ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
112752025-01-15T00:55:52.734ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
112762025-01-15T00:55:52.734ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
112772025-01-15T00:55:52.734ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 130.970071ms iteration = 12 status = {"generation":2}
112782025-01-15T00:55:52.736ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
112792025-01-15T00:55:52.736ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
112802025-01-15T00:55:52.750ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112812025-01-15T00:55:52.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112822025-01-15T00:55:52.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112832025-01-15T00:55:52.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112842025-01-15T00:55:52.755ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
112852025-01-15T00:55:52.755ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112862025-01-15T00:55:52.755ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "09d94056-6cf6-4ddd-b421-ad17d156bb73", "content-length": "26", "date": "Wed, 15 Jan 2025 00:55:51 GMT"} })
112872025-01-15T00:55:52.755ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112882025-01-15T00:55:52.757ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
112892025-01-15T00:55:52.757ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 152.864453ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
112902025-01-15T00:55:52.757ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112912025-01-15T00:55:52.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.929403ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
112922025-01-15T00:55:52.767ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112932025-01-15T00:55:52.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112942025-01-15T00:55:52.769ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
112952025-01-15T00:55:52.769ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 166.223969ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
112962025-01-15T00:55:52.786ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
112972025-01-15T00:55:52.786ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112982025-01-15T00:55:52.786ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "61cb919f-3acf-42f5-9b43-95be8ea89e9f", "content-length": "26", "date": "Wed, 15 Jan 2025 00:55:51 GMT"} })
112992025-01-15T00:55:52.786ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113002025-01-15T00:55:52.786ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
113012025-01-15T00:55:52.786ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113022025-01-15T00:55:52.786ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4825ad6e-4346-4856-9cd0-5999fb3ba0ba", "content-length": "26", "date": "Wed, 15 Jan 2025 00:55:51 GMT"} })
113032025-01-15T00:55:52.786ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113042025-01-15T00:55:52.789ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
113052025-01-15T00:55:52.789ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113062025-01-15T00:55:52.790ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
113072025-01-15T00:55:52.790ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
113082025-01-15T00:55:52.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113092025-01-15T00:55:52.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113102025-01-15T00:55:52.793ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 188.62889ms iteration = 26 status = {"physical_disks_added":0}
113112025-01-15T00:55:52.813ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113122025-01-15T00:55:52.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113132025-01-15T00:55:52.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 890aba63-f2e1-4e49-961d-dedeba2bcf28 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
113142025-01-15T00:55:52.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 890aba63-f2e1-4e49-961d-dedeba2bcf28 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
113152025-01-15T00:55:52.841ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
113162025-01-15T00:55:52.841ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 233.927912ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
113172025-01-15T00:55:52.919ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
113182025-01-15T00:55:52.919ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "266b9487-8292-4c21-9d75-599535a30478", "content-length": "1", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
113192025-01-15T00:55:52.921ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113202025-01-15T00:55:52.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113212025-01-15T00:55:53.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
113222025-01-15T00:55:53.005ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
113232025-01-15T00:55:53.006ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "935f4606-498e-4e20-801b-49f994cabd4e", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113242025-01-15T00:55:53.006ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113252025-01-15T00:55:53.008ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "90fa4d57-d47a-4459-8d5b-dc9bc8e606e6", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113262025-01-15T00:55:53.008ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113272025-01-15T00:55:53.009ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113282025-01-15T00:55:53.009ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 406.192537ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
113292025-01-15T00:55:53.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 2e52adc6-9c96-42ca-9f8b-c721fb5e3427 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
113302025-01-15T00:55:53.045ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 442.462996ms iteration = 23 status = {}
113312025-01-15T00:55:53.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 2e52adc6-9c96-42ca-9f8b-c721fb5e3427 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
113322025-01-15T00:55:53.059ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
113332025-01-15T00:55:53.059ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113342025-01-15T00:55:53.059ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4405cfc2-9015-455c-bef1-2aa420cc96c3", "content-length": "372", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
113352025-01-15T00:55:53.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113362025-01-15T00:55:53.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113372025-01-15T00:55:53.061ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113382025-01-15T00:55:53.061ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113392025-01-15T00:55:53.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 890aba63-f2e1-4e49-961d-dedeba2bcf28 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
113402025-01-15T00:55:53.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113412025-01-15T00:55:53.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113422025-01-15T00:55:53.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113432025-01-15T00:55:53.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
113442025-01-15T00:55:53.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113452025-01-15T00:55:53.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113462025-01-15T00:55:53.066ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 463.346367ms iteration = 23 status = null
113472025-01-15T00:55:53.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113482025-01-15T00:55:53.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22547 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 2e52adc6-9c96-42ca-9f8b-c721fb5e3427 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
113492025-01-15T00:55:53.068ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
113502025-01-15T00:55:53.068ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
113512025-01-15T00:55:53.068ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
113522025-01-15T00:55:53.068ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 465.263654ms iteration = 12 status = {"generation":1}
113532025-01-15T00:55:53.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113542025-01-15T00:55:53.069ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113552025-01-15T00:55:53.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113562025-01-15T00:55:53.079ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
113572025-01-15T00:55:53.079ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
113582025-01-15T00:55:53.079ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4161c524-6094-437d-b17b-25dfb2bba91d", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
113592025-01-15T00:55:53.079ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113602025-01-15T00:55:53.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113612025-01-15T00:55:53.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113622025-01-15T00:55:53.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113632025-01-15T00:55:53.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113642025-01-15T00:55:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113652025-01-15T00:55:53.087ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113662025-01-15T00:55:53.087ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113672025-01-15T00:55:53.087ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "503fda63-3d5f-49d8-9775-c4e26555a97c", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
113682025-01-15T00:55:53.089ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 482.403224ms iteration = 23 status = {}
113692025-01-15T00:55:53.126ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
113702025-01-15T00:55:53.127ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c8e9d75f-a320-4ccd-aeb4-c368b05669ba", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113712025-01-15T00:55:53.127ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113722025-01-15T00:55:53.128ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "719cdcf5-a8fd-4d9a-a3b0-0f66bd118eaa", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113732025-01-15T00:55:53.128ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113742025-01-15T00:55:53.130ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a7485da7-b75b-4d5c-9c6f-664848c45630", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113752025-01-15T00:55:53.130ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113762025-01-15T00:55:53.132ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
113772025-01-15T00:55:53.132ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 529.140514ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
113782025-01-15T00:55:53.153ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
113792025-01-15T00:55:53.154ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "66490083-0ac7-4ce5-acf4-e316a0c564fc", "content-length": "691", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
113802025-01-15T00:55:53.154ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
113812025-01-15T00:55:53.154ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
113822025-01-15T00:55:53.154ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
113832025-01-15T00:55:53.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113842025-01-15T00:55:53.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113852025-01-15T00:55:53.155ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 548.065917ms iteration = 23 status = {}
113862025-01-15T00:55:53.157ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
113872025-01-15T00:55:53.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
113882025-01-15T00:55:53.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
113892025-01-15T00:55:53.166ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
113902025-01-15T00:55:53.166ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a035a09-ae17-4711-8b45-b5420ec00027", "content-length": "134", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
113912025-01-15T00:55:53.166ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
113922025-01-15T00:55:53.166ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
113932025-01-15T00:55:53.166ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
113942025-01-15T00:55:53.166ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
113952025-01-15T00:55:53.166ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113962025-01-15T00:55:53.167ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113972025-01-15T00:55:53.167ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
113982025-01-15T00:55:53.167ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
113992025-01-15T00:55:53.167ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114002025-01-15T00:55:53.167ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114012025-01-15T00:55:53.167ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
114022025-01-15T00:55:53.167ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114032025-01-15T00:55:53.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114042025-01-15T00:55:53.169ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
114052025-01-15T00:55:53.169ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5659a63f-b4ae-4b5a-8e10-dfa452b370b9", "content-length": "2", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
114062025-01-15T00:55:53.169ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
114072025-01-15T00:55:53.169ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5006ed80-897f-462d-851e-91edc1c5df47", "content-length": "51", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
114082025-01-15T00:55:53.169ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
114092025-01-15T00:55:53.169ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
114102025-01-15T00:55:53.264ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a6fc7ecf-943a-468c-b35c-913e49345414", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
114112025-01-15T00:55:53.265ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
114122025-01-15T00:55:53.265ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
114132025-01-15T00:55:53.265ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe3e345f-d41a-46ba-a163-b6848a72132e", "content-length": "682", "date": "Wed, 15 Jan 2025 00:55:52 GMT"} })
114142025-01-15T00:55:53.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114152025-01-15T00:55:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114162025-01-15T00:55:53.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114172025-01-15T00:55:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114182025-01-15T00:55:53.270ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114192025-01-15T00:55:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114202025-01-15T00:55:53.272ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114212025-01-15T00:55:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114222025-01-15T00:55:53.279ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 674.796287ms iteration = 23 status = {}
114232025-01-15T00:55:53.386ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
114242025-01-15T00:55:53.386ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
114252025-01-15T00:55:53.426ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
114262025-01-15T00:55:53.427ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:59073
114272025-01-15T00:55:53.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:59073 req_id = 84c1b720-d28a-4964-8e2b-2b80c84a0b04 roles = RoleSet { roles: {} } uri = /metrics/producers
114282025-01-15T00:55:53.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:59073 req_id = 84c1b720-d28a-4964-8e2b-2b80c84a0b04 resource = Database result = Ok(()) uri = /metrics/producers
114292025-01-15T00:55:53.484ZINFOnexus: assigned collector to new producer collector_id = dee7453b-558a-4d94-b6a0-8b27cb27f002 file = nexus/src/app/oximeter.rs:76 producer_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
114302025-01-15T00:55:53.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57773 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:59073 req_id = 84c1b720-d28a-4964-8e2b-2b80c84a0b04 response_code = 201 uri = /metrics/producers
114312025-01-15T00:55:53.485ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "84c1b720-d28a-4964-8e2b-2b80c84a0b04", "content-length": "41", "date": "Wed, 15 Jan 2025 00:55:53 GMT"} })
114322025-01-15T00:55:53.488ZDEBGnexus (producer-registration-task): registered with nexus successfully
114332025-01-15T00:55:53.489ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
114342025-01-15T00:55:54.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f039e777-b97f-438c-b058-07cc923d6266 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114352025-01-15T00:55:54.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f039e777-b97f-438c-b058-07cc923d6266 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114362025-01-15T00:55:54.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2686 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f039e777-b97f-438c-b058-07cc923d6266 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114372025-01-15T00:55:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 711284cc-6aba-4f96-85c2-fb14b275d8ee response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
114382025-01-15T00:55:55.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f6649d9-bc59-44b6-8530-a7184a01c579 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114392025-01-15T00:55:55.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f6649d9-bc59-44b6-8530-a7184a01c579 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114402025-01-15T00:55:55.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2f6649d9-bc59-44b6-8530-a7184a01c579 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114412025-01-15T00:55:56.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2c0fa40d-8dd6-4d9f-87c8-1c9099a43a89 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114422025-01-15T00:55:56.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2c0fa40d-8dd6-4d9f-87c8-1c9099a43a89 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114432025-01-15T00:55:56.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2c0fa40d-8dd6-4d9f-87c8-1c9099a43a89 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114442025-01-15T00:55:57.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ba03798-0442-4f5c-b271-9d515c153415 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114452025-01-15T00:55:57.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ba03798-0442-4f5c-b271-9d515c153415 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114462025-01-15T00:55:57.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ba03798-0442-4f5c-b271-9d515c153415 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114472025-01-15T00:55:58.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b5aa63a4-7a62-4c50-a674-523ad0e62c05 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114482025-01-15T00:55:58.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b5aa63a4-7a62-4c50-a674-523ad0e62c05 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114492025-01-15T00:55:58.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b5aa63a4-7a62-4c50-a674-523ad0e62c05 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114502025-01-15T00:55:59.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 141ca105-e999-459b-94e5-6c0ba38cdd10 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114512025-01-15T00:55:59.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 141ca105-e999-459b-94e5-6c0ba38cdd10 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114522025-01-15T00:55:59.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 141ca105-e999-459b-94e5-6c0ba38cdd10 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114532025-01-15T00:56:00.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fefe64cd-f423-45c4-a167-815239d54b4b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114542025-01-15T00:56:00.215ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fefe64cd-f423-45c4-a167-815239d54b4b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114552025-01-15T00:56:00.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fefe64cd-f423-45c4-a167-815239d54b4b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114562025-01-15T00:56:01.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cee6ef55-e022-42d1-a3e2-192ca264fc06 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114572025-01-15T00:56:01.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cee6ef55-e022-42d1-a3e2-192ca264fc06 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114582025-01-15T00:56:01.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cee6ef55-e022-42d1-a3e2-192ca264fc06 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114592025-01-15T00:56:02.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 45dc1aa2-560b-4c5a-8074-ffe923eefb6b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114602025-01-15T00:56:02.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 45dc1aa2-560b-4c5a-8074-ffe923eefb6b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114612025-01-15T00:56:02.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2021 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 45dc1aa2-560b-4c5a-8074-ffe923eefb6b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114622025-01-15T00:56:02.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
114632025-01-15T00:56:02.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114642025-01-15T00:56:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114652025-01-15T00:56:02.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114662025-01-15T00:56:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
114672025-01-15T00:56:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114682025-01-15T00:56:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114692025-01-15T00:56:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
114702025-01-15T00:56:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114712025-01-15T00:56:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114722025-01-15T00:56:02.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
114732025-01-15T00:56:02.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114742025-01-15T00:56:02.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
114752025-01-15T00:56:02.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114762025-01-15T00:56:02.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.715102ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
114772025-01-15T00:56:02.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114782025-01-15T00:56:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
114792025-01-15T00:56:02.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
114802025-01-15T00:56:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
114812025-01-15T00:56:02.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
114822025-01-15T00:56:02.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.488404ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
114832025-01-15T00:56:03.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cd08a769-6746-46bd-9b6e-301bf95527bb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114842025-01-15T00:56:03.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cd08a769-6746-46bd-9b6e-301bf95527bb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114852025-01-15T00:56:03.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2583 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cd08a769-6746-46bd-9b6e-301bf95527bb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114862025-01-15T00:56:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 590 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 8c2322a2-61f0-4406-ad46-41bd953bdd9e response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
114872025-01-15T00:56:04.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 91552336-74e8-4920-adaf-f741b4c6909d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114882025-01-15T00:56:04.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 91552336-74e8-4920-adaf-f741b4c6909d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114892025-01-15T00:56:04.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2276 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 91552336-74e8-4920-adaf-f741b4c6909d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114902025-01-15T00:56:05.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46bc7744-fd94-4d3c-bd38-0c06a4d68161 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114912025-01-15T00:56:05.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46bc7744-fd94-4d3c-bd38-0c06a4d68161 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114922025-01-15T00:56:05.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2056 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46bc7744-fd94-4d3c-bd38-0c06a4d68161 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114932025-01-15T00:56:06.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab2359d7-bd5c-4f14-9444-b1cd3777effb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114942025-01-15T00:56:06.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab2359d7-bd5c-4f14-9444-b1cd3777effb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114952025-01-15T00:56:06.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab2359d7-bd5c-4f14-9444-b1cd3777effb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114962025-01-15T00:56:07.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0b96841f-ee5a-40b6-b3bc-2e60b1c458f5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114972025-01-15T00:56:07.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0b96841f-ee5a-40b6-b3bc-2e60b1c458f5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114982025-01-15T00:56:07.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1986 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0b96841f-ee5a-40b6-b3bc-2e60b1c458f5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
114992025-01-15T00:56:08.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bf0045ff-a123-4152-aa5a-37cd98d50a60 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115002025-01-15T00:56:08.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bf0045ff-a123-4152-aa5a-37cd98d50a60 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115012025-01-15T00:56:08.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2382 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = bf0045ff-a123-4152-aa5a-37cd98d50a60 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115022025-01-15T00:56:09.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 945a55e5-9259-4aef-a493-6deef90efdd0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115032025-01-15T00:56:09.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 945a55e5-9259-4aef-a493-6deef90efdd0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115042025-01-15T00:56:09.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2250 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 945a55e5-9259-4aef-a493-6deef90efdd0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115052025-01-15T00:56:10.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5fcd6f75-4bef-4f94-b7b2-f73ea0575b5c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115062025-01-15T00:56:10.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5fcd6f75-4bef-4f94-b7b2-f73ea0575b5c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115072025-01-15T00:56:10.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5fcd6f75-4bef-4f94-b7b2-f73ea0575b5c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115082025-01-15T00:56:11.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7e4c0db-7592-4501-87b8-c4f4641b165d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115092025-01-15T00:56:11.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7e4c0db-7592-4501-87b8-c4f4641b165d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115102025-01-15T00:56:11.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7e4c0db-7592-4501-87b8-c4f4641b165d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115112025-01-15T00:56:12.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99838433-1922-42ea-b2af-4f390f720dfc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115122025-01-15T00:56:12.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99838433-1922-42ea-b2af-4f390f720dfc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115132025-01-15T00:56:12.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1555 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99838433-1922-42ea-b2af-4f390f720dfc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115142025-01-15T00:56:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
115152025-01-15T00:56:12.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115162025-01-15T00:56:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115172025-01-15T00:56:12.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115182025-01-15T00:56:12.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
115192025-01-15T00:56:12.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115202025-01-15T00:56:12.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115212025-01-15T00:56:12.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
115222025-01-15T00:56:12.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115232025-01-15T00:56:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115242025-01-15T00:56:12.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115252025-01-15T00:56:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115262025-01-15T00:56:12.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
115272025-01-15T00:56:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
115282025-01-15T00:56:12.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115292025-01-15T00:56:12.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.367795ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
115302025-01-15T00:56:12.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
115312025-01-15T00:56:12.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115322025-01-15T00:56:12.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115332025-01-15T00:56:12.621ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
115342025-01-15T00:56:12.621ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.603478ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
115352025-01-15T00:56:13.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 24c1f838-789c-43fc-9c80-04c08eec9736 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115362025-01-15T00:56:13.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 24c1f838-789c-43fc-9c80-04c08eec9736 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115372025-01-15T00:56:13.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2482 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 24c1f838-789c-43fc-9c80-04c08eec9736 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115382025-01-15T00:56:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 533 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 77527adc-4d7d-462f-99e8-9d8c98ed17ed response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
115392025-01-15T00:56:14.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 269b289b-2577-44ed-8d86-43a9a43e6caf roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115402025-01-15T00:56:14.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 269b289b-2577-44ed-8d86-43a9a43e6caf resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115412025-01-15T00:56:14.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2363 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 269b289b-2577-44ed-8d86-43a9a43e6caf response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115422025-01-15T00:56:15.541ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8dac0504-6b1f-4b38-b166-938422c01956 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115432025-01-15T00:56:15.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8dac0504-6b1f-4b38-b166-938422c01956 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115442025-01-15T00:56:15.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1951 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8dac0504-6b1f-4b38-b166-938422c01956 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115452025-01-15T00:56:16.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e86e1b49-a52f-4262-ad29-c5520fe22732 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115462025-01-15T00:56:16.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e86e1b49-a52f-4262-ad29-c5520fe22732 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115472025-01-15T00:56:16.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1913 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e86e1b49-a52f-4262-ad29-c5520fe22732 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115482025-01-15T00:56:17.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46df6b00-bf19-41fd-b243-ede5f1b5dd85 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115492025-01-15T00:56:17.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46df6b00-bf19-41fd-b243-ede5f1b5dd85 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115502025-01-15T00:56:17.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2690 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 46df6b00-bf19-41fd-b243-ede5f1b5dd85 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115512025-01-15T00:56:18.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 82adb735-aeb5-4672-8c79-c1c77d1c6df5 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115522025-01-15T00:56:18.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 82adb735-aeb5-4672-8c79-c1c77d1c6df5 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115532025-01-15T00:56:18.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 82adb735-aeb5-4672-8c79-c1c77d1c6df5 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115542025-01-15T00:56:19.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5a0adb82-e2be-4a28-9bfc-9d383972ef39 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
115552025-01-15T00:56:19.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5a0adb82-e2be-4a28-9bfc-9d383972ef39 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
115562025-01-15T00:56:19.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 5a0adb82-e2be-4a28-9bfc-9d383972ef39 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
115572025-01-15T00:56:19.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 185f1d92-0a94-4368-bf63-343277adad9b roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
115582025-01-15T00:56:19.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 185f1d92-0a94-4368-bf63-343277adad9b resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
115592025-01-15T00:56:19.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2081 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 185f1d92-0a94-4368-bf63-343277adad9b response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
115602025-01-15T00:56:19.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9cd7ed6-1121-4ab9-8712-5c6c381de4ad roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115612025-01-15T00:56:19.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9cd7ed6-1121-4ab9-8712-5c6c381de4ad resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115622025-01-15T00:56:19.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c9cd7ed6-1121-4ab9-8712-5c6c381de4ad response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115632025-01-15T00:56:20.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0972c10b-06ee-47a6-a1d4-c5f7e8c60589 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115642025-01-15T00:56:20.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0972c10b-06ee-47a6-a1d4-c5f7e8c60589 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115652025-01-15T00:56:20.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0972c10b-06ee-47a6-a1d4-c5f7e8c60589 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115662025-01-15T00:56:21.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b996e80-4f3f-432b-9851-27c34a26dae4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115672025-01-15T00:56:21.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b996e80-4f3f-432b-9851-27c34a26dae4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115682025-01-15T00:56:21.670ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b996e80-4f3f-432b-9851-27c34a26dae4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
115692025-01-15T00:56:22.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
115702025-01-15T00:56:22.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
115712025-01-15T00:56:22.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
115722025-01-15T00:56:22.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115732025-01-15T00:56:22.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
115742025-01-15T00:56:22.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
115752025-01-15T00:56:22.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
115762025-01-15T00:56:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115772025-01-15T00:56:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
115782025-01-15T00:56:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
115792025-01-15T00:56:22.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
115802025-01-15T00:56:22.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
115812025-01-15T00:56:22.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
115822025-01-15T00:56:22.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
115832025-01-15T00:56:22.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115842025-01-15T00:56:22.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
115852025-01-15T00:56:22.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
115862025-01-15T00:56:22.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
115872025-01-15T00:56:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115882025-01-15T00:56:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
115892025-01-15T00:56:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
115902025-01-15T00:56:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
115912025-01-15T00:56:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1602, tv_nsec: 935619047 } })
115922025-01-15T00:56:22.605ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
115932025-01-15T00:56:22.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.211821ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
115942025-01-15T00:56:22.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115952025-01-15T00:56:22.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1602, tv_nsec: 936229998 } })
115962025-01-15T00:56:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
115972025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115982025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115992025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
116002025-01-15T00:56:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
116012025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116022025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
116032025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116042025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
116052025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116062025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
116072025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
116082025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116092025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
116102025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116112025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
116122025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
116132025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116142025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116152025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116162025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116172025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116182025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
116192025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
116202025-01-15T00:56:22.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116212025-01-15T00:56:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
116222025-01-15T00:56:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
116232025-01-15T00:56:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
116242025-01-15T00:56:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116252025-01-15T00:56:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
116262025-01-15T00:56:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
116272025-01-15T00:56:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
116282025-01-15T00:56:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116292025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
116302025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
116312025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116322025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
116332025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116342025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116352025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116362025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
116372025-01-15T00:56:22.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116382025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116392025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
116402025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
116412025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116422025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116432025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
116442025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116452025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116462025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116472025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
116482025-01-15T00:56:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116492025-01-15T00:56:22.612ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116502025-01-15T00:56:22.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116512025-01-15T00:56:22.613ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116522025-01-15T00:56:22.614ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116532025-01-15T00:56:22.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116542025-01-15T00:56:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116552025-01-15T00:56:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
116562025-01-15T00:56:22.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
116572025-01-15T00:56:22.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
116582025-01-15T00:56:22.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116592025-01-15T00:56:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116602025-01-15T00:56:22.619ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1602, tv_nsec: 949019285 } })
116612025-01-15T00:56:22.619ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
116622025-01-15T00:56:22.619ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116632025-01-15T00:56:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116642025-01-15T00:56:22.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116652025-01-15T00:56:22.621ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116662025-01-15T00:56:22.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116672025-01-15T00:56:22.622ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
116682025-01-15T00:56:22.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
116692025-01-15T00:56:22.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
116702025-01-15T00:56:22.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
116712025-01-15T00:56:22.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
116722025-01-15T00:56:22.645ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 35.617555ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
116732025-01-15T00:56:22.647ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
116742025-01-15T00:56:22.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
116752025-01-15T00:56:22.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116762025-01-15T00:56:22.648ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.04023ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116772025-01-15T00:56:22.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116782025-01-15T00:56:22.651ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116792025-01-15T00:56:22.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116802025-01-15T00:56:22.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116812025-01-15T00:56:22.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.378535ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
116822025-01-15T00:56:22.653ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
116832025-01-15T00:56:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
116842025-01-15T00:56:22.656ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116852025-01-15T00:56:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
116862025-01-15T00:56:22.657ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
116872025-01-15T00:56:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
116882025-01-15T00:56:22.657ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116892025-01-15T00:56:22.657ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
116902025-01-15T00:56:22.657ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
116912025-01-15T00:56:22.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
116922025-01-15T00:56:22.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
116932025-01-15T00:56:22.659ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116942025-01-15T00:56:22.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116952025-01-15T00:56:22.660ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.228892ms iteration = 24 status = 0
116962025-01-15T00:56:22.660ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
116972025-01-15T00:56:22.660ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.163793ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
116982025-01-15T00:56:22.660ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
116992025-01-15T00:56:22.660ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
117002025-01-15T00:56:22.660ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117012025-01-15T00:56:22.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117022025-01-15T00:56:22.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117032025-01-15T00:56:22.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117042025-01-15T00:56:22.663ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
117052025-01-15T00:56:22.663ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
117062025-01-15T00:56:22.663ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 55.790124ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
117072025-01-15T00:56:22.663ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.386956ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117082025-01-15T00:56:22.664ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117092025-01-15T00:56:22.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117102025-01-15T00:56:22.665ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117112025-01-15T00:56:22.665ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117122025-01-15T00:56:22.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
117132025-01-15T00:56:22.668ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
117142025-01-15T00:56:22.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
117152025-01-15T00:56:22.668ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117162025-01-15T00:56:22.668ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117172025-01-15T00:56:22.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117182025-01-15T00:56:22.669ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
117192025-01-15T00:56:22.669ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.585461ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
117202025-01-15T00:56:22.669ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
117212025-01-15T00:56:22.669ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 64.94235ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
117222025-01-15T00:56:22.686ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117232025-01-15T00:56:22.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117242025-01-15T00:56:22.690ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 80.318675ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
117252025-01-15T00:56:22.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99922e54-e436-4776-bb4e-d2196cc89eb6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
117262025-01-15T00:56:22.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99922e54-e436-4776-bb4e-d2196cc89eb6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
117272025-01-15T00:56:22.691ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 81.523859ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
117282025-01-15T00:56:22.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2798 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 99922e54-e436-4776-bb4e-d2196cc89eb6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
117292025-01-15T00:56:22.710ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 105.558701ms iteration = 27 status = {"physical_disks_added":0}
117302025-01-15T00:56:22.716ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
117312025-01-15T00:56:22.716ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
117322025-01-15T00:56:22.716ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "154e47fb-be59-4333-bd6e-e8119d76749c", "content-length": "26", "date": "Wed, 15 Jan 2025 00:56:21 GMT"} })
117332025-01-15T00:56:22.716ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
117342025-01-15T00:56:22.718ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
117352025-01-15T00:56:22.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117362025-01-15T00:56:22.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117372025-01-15T00:56:22.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117382025-01-15T00:56:22.726ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117392025-01-15T00:56:22.726ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117402025-01-15T00:56:22.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117412025-01-15T00:56:22.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117422025-01-15T00:56:22.729ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
117432025-01-15T00:56:22.729ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117442025-01-15T00:56:22.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117452025-01-15T00:56:22.752ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
117462025-01-15T00:56:22.752ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
117472025-01-15T00:56:22.753ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6fbe3d9-ee68-4a5d-9504-5049dd15ab21", "content-length": "26", "date": "Wed, 15 Jan 2025 00:56:21 GMT"} })
117482025-01-15T00:56:22.753ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
117492025-01-15T00:56:22.755ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
117502025-01-15T00:56:22.837ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
117512025-01-15T00:56:22.837ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
117522025-01-15T00:56:22.837ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c864597-9538-41c7-86af-40fc9a93533d", "content-length": "26", "date": "Wed, 15 Jan 2025 00:56:21 GMT"} })
117532025-01-15T00:56:22.837ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
117542025-01-15T00:56:22.839ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
117552025-01-15T00:56:22.862ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
117562025-01-15T00:56:22.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
117572025-01-15T00:56:22.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbf4049d-ba77-4abe-8e06-dc74d3cdacdc", "content-length": "372", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
117582025-01-15T00:56:22.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117592025-01-15T00:56:22.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117602025-01-15T00:56:22.863ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
117612025-01-15T00:56:22.863ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0231a10-d4d1-4e67-9cf6-0fc1ecd3c73f", "content-length": "1", "date": "Wed, 15 Jan 2025 00:56:21 GMT"} })
117622025-01-15T00:56:22.865ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117632025-01-15T00:56:22.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117642025-01-15T00:56:22.867ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 264.44713ms iteration = 24 status = null
117652025-01-15T00:56:22.870ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
117662025-01-15T00:56:22.871ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e25d33af-439b-4137-a9c0-28be6ccd6811", "content-length": "691", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
117672025-01-15T00:56:22.871ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
117682025-01-15T00:56:22.871ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
117692025-01-15T00:56:22.871ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
117702025-01-15T00:56:22.872ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 265.00393ms iteration = 24 status = {}
117712025-01-15T00:56:22.876ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
117722025-01-15T00:56:22.876ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
117732025-01-15T00:56:22.876ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "db200d1d-0fa0-4e0c-a936-b7aed614ff12", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
117742025-01-15T00:56:22.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117752025-01-15T00:56:22.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117762025-01-15T00:56:22.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117772025-01-15T00:56:22.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117782025-01-15T00:56:22.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117792025-01-15T00:56:22.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117802025-01-15T00:56:22.885ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
117812025-01-15T00:56:22.885ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
117822025-01-15T00:56:22.885ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0b9489f2-fdc4-4fe9-833a-293b8ef506ff", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
117832025-01-15T00:56:22.887ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 280.017049ms iteration = 24 status = {}
117842025-01-15T00:56:22.916ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 313.891201ms iteration = 24 status = {}
117852025-01-15T00:56:22.965ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117862025-01-15T00:56:22.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117872025-01-15T00:56:22.968ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
117882025-01-15T00:56:22.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117892025-01-15T00:56:22.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117902025-01-15T00:56:22.982ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
117912025-01-15T00:56:22.982ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3ad467d-bf16-4c20-ac47-114c3123ea29", "content-length": "134", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
117922025-01-15T00:56:22.982ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
117932025-01-15T00:56:22.982ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
117942025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
117952025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
117962025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117972025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117982025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
117992025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
118002025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
118012025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
118022025-01-15T00:56:22.983ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
118032025-01-15T00:56:22.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118042025-01-15T00:56:22.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118052025-01-15T00:56:22.986ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
118062025-01-15T00:56:22.986ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2529a379-3517-4d06-af29-015bc6098d1f", "content-length": "2", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
118072025-01-15T00:56:22.986ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
118082025-01-15T00:56:22.986ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "571a8027-03df-428a-83b3-65472fce4255", "content-length": "51", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
118092025-01-15T00:56:22.986ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
118102025-01-15T00:56:22.986ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
118112025-01-15T00:56:23.077ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "58c2dacc-4145-491b-8dfa-5c004c615f40", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
118122025-01-15T00:56:23.077ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
118132025-01-15T00:56:23.077ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
118142025-01-15T00:56:23.077ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dc5d4b0-4250-49d7-8883-1c50f9203b5b", "content-length": "682", "date": "Wed, 15 Jan 2025 00:56:22 GMT"} })
118152025-01-15T00:56:23.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118162025-01-15T00:56:23.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118172025-01-15T00:56:23.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118182025-01-15T00:56:23.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118192025-01-15T00:56:23.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118202025-01-15T00:56:23.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118212025-01-15T00:56:23.088ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118222025-01-15T00:56:23.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118232025-01-15T00:56:23.095ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 491.00056ms iteration = 24 status = {}
118242025-01-15T00:56:23.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c4b0f276-a1e0-4c2b-9ee6-c28ba09fb22e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
118252025-01-15T00:56:23.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c4b0f276-a1e0-4c2b-9ee6-c28ba09fb22e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
118262025-01-15T00:56:23.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3558 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c4b0f276-a1e0-4c2b-9ee6-c28ba09fb22e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
118272025-01-15T00:56:23.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60b4fef6-317a-48c2-9d9b-5721aef78a58 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118282025-01-15T00:56:23.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60b4fef6-317a-48c2-9d9b-5721aef78a58 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118292025-01-15T00:56:23.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60b4fef6-317a-48c2-9d9b-5721aef78a58 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118302025-01-15T00:56:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 527 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 7db4bf32-97cc-436c-96a5-a69e786b9cae response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
118312025-01-15T00:56:24.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ad231b6-b67c-496f-9a0e-2cc8bd9958ca roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118322025-01-15T00:56:24.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ad231b6-b67c-496f-9a0e-2cc8bd9958ca resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118332025-01-15T00:56:24.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1513 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ad231b6-b67c-496f-9a0e-2cc8bd9958ca response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118342025-01-15T00:56:25.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea3a2e7d-116d-4e20-aecb-8d5fb05c4e64 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118352025-01-15T00:56:25.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea3a2e7d-116d-4e20-aecb-8d5fb05c4e64 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118362025-01-15T00:56:25.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2291 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea3a2e7d-116d-4e20-aecb-8d5fb05c4e64 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118372025-01-15T00:56:26.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5af8263a-584e-45e9-bd81-f3414e735fc0 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118382025-01-15T00:56:26.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5af8263a-584e-45e9-bd81-f3414e735fc0 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118392025-01-15T00:56:26.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2361 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5af8263a-584e-45e9-bd81-f3414e735fc0 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118402025-01-15T00:56:27.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ba20eb7-87d7-4fb0-a5a9-cb1cf541d994 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118412025-01-15T00:56:27.797ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ba20eb7-87d7-4fb0-a5a9-cb1cf541d994 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118422025-01-15T00:56:27.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5ba20eb7-87d7-4fb0-a5a9-cb1cf541d994 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118432025-01-15T00:56:28.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b944106-29c1-4202-957b-4242fc3eaac8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118442025-01-15T00:56:28.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b944106-29c1-4202-957b-4242fc3eaac8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118452025-01-15T00:56:28.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1887 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8b944106-29c1-4202-957b-4242fc3eaac8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118462025-01-15T00:56:29.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a515f38-dae1-4221-afa3-63c5452db596 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118472025-01-15T00:56:29.838ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a515f38-dae1-4221-afa3-63c5452db596 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118482025-01-15T00:56:29.840ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2014 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5a515f38-dae1-4221-afa3-63c5452db596 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118492025-01-15T00:56:30.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49fdd11a-93c5-4b92-a0dc-952093864818 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118502025-01-15T00:56:30.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49fdd11a-93c5-4b92-a0dc-952093864818 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118512025-01-15T00:56:30.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2677 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 49fdd11a-93c5-4b92-a0dc-952093864818 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118522025-01-15T00:56:31.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2ebba8a0-4364-48af-a18b-8bbf535b8259 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118532025-01-15T00:56:31.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2ebba8a0-4364-48af-a18b-8bbf535b8259 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118542025-01-15T00:56:31.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2454 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2ebba8a0-4364-48af-a18b-8bbf535b8259 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118552025-01-15T00:56:32.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
118562025-01-15T00:56:32.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118572025-01-15T00:56:32.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118582025-01-15T00:56:32.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118592025-01-15T00:56:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118602025-01-15T00:56:32.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118612025-01-15T00:56:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118622025-01-15T00:56:32.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
118632025-01-15T00:56:32.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118642025-01-15T00:56:32.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118652025-01-15T00:56:32.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118662025-01-15T00:56:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118672025-01-15T00:56:32.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118682025-01-15T00:56:32.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118692025-01-15T00:56:32.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118702025-01-15T00:56:32.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.310244ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118712025-01-15T00:56:32.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
118722025-01-15T00:56:32.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118732025-01-15T00:56:32.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118742025-01-15T00:56:32.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
118752025-01-15T00:56:32.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.130435ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
118762025-01-15T00:56:32.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 632ec565-0a9e-404c-9585-e57a27034830 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118772025-01-15T00:56:32.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 632ec565-0a9e-404c-9585-e57a27034830 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118782025-01-15T00:56:32.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 632ec565-0a9e-404c-9585-e57a27034830 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118792025-01-15T00:56:33.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 365949ae-7797-4285-90c1-6e6fd934e5ae roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118802025-01-15T00:56:33.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 365949ae-7797-4285-90c1-6e6fd934e5ae resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118812025-01-15T00:56:33.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 365949ae-7797-4285-90c1-6e6fd934e5ae response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118822025-01-15T00:56:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = bd0446fd-6ec3-43cc-a6dc-c9352c0f6e1f response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
118832025-01-15T00:56:34.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32593b3e-13fa-44d6-9fa0-3570bbb921dd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118842025-01-15T00:56:34.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32593b3e-13fa-44d6-9fa0-3570bbb921dd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118852025-01-15T00:56:34.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32593b3e-13fa-44d6-9fa0-3570bbb921dd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118862025-01-15T00:56:35.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cf507f92-3e18-4fb5-bd5c-68417e5a29a9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118872025-01-15T00:56:35.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cf507f92-3e18-4fb5-bd5c-68417e5a29a9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118882025-01-15T00:56:35.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2023 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cf507f92-3e18-4fb5-bd5c-68417e5a29a9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118892025-01-15T00:56:36.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7445a36-ca79-441c-b374-ff56080acedd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118902025-01-15T00:56:36.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7445a36-ca79-441c-b374-ff56080acedd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118912025-01-15T00:56:36.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e7445a36-ca79-441c-b374-ff56080acedd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118922025-01-15T00:56:38.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85f96061-96de-4c1f-86e3-6c9262c3fd21 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118932025-01-15T00:56:38.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85f96061-96de-4c1f-86e3-6c9262c3fd21 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118942025-01-15T00:56:38.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85f96061-96de-4c1f-86e3-6c9262c3fd21 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118952025-01-15T00:56:39.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5efacb59-e3ce-4cfb-a8c2-b970e5350cda roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118962025-01-15T00:56:39.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5efacb59-e3ce-4cfb-a8c2-b970e5350cda resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118972025-01-15T00:56:39.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1811 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5efacb59-e3ce-4cfb-a8c2-b970e5350cda response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118982025-01-15T00:56:40.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ba973388-18eb-4a22-99c0-3663a86b9679 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
118992025-01-15T00:56:40.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ba973388-18eb-4a22-99c0-3663a86b9679 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119002025-01-15T00:56:40.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ba973388-18eb-4a22-99c0-3663a86b9679 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119012025-01-15T00:56:41.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88a07d47-db11-40e8-b6ac-645a5da0152d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119022025-01-15T00:56:41.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88a07d47-db11-40e8-b6ac-645a5da0152d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119032025-01-15T00:56:41.082ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2580 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88a07d47-db11-40e8-b6ac-645a5da0152d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119042025-01-15T00:56:41.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 407a5f4f-2c9f-4872-948e-ea6871bbbb60 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
119052025-01-15T00:56:41.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 407a5f4f-2c9f-4872-948e-ea6871bbbb60 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
119062025-01-15T00:56:41.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6301 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 407a5f4f-2c9f-4872-948e-ea6871bbbb60 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
119072025-01-15T00:56:41.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 78556817-cba8-4143-be3e-d1f069a1ac58 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
119082025-01-15T00:56:41.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 78556817-cba8-4143-be3e-d1f069a1ac58 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
119092025-01-15T00:56:41.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4082 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 78556817-cba8-4143-be3e-d1f069a1ac58 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
119102025-01-15T00:56:42.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e1b08b63-7f40-4788-a1f0-acd4569dc2f6 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119112025-01-15T00:56:42.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e1b08b63-7f40-4788-a1f0-acd4569dc2f6 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119122025-01-15T00:56:42.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e1b08b63-7f40-4788-a1f0-acd4569dc2f6 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119132025-01-15T00:56:42.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
119142025-01-15T00:56:42.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119152025-01-15T00:56:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119162025-01-15T00:56:42.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119172025-01-15T00:56:42.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
119182025-01-15T00:56:42.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119192025-01-15T00:56:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119202025-01-15T00:56:42.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119212025-01-15T00:56:42.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119222025-01-15T00:56:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119232025-01-15T00:56:42.611ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119242025-01-15T00:56:42.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119252025-01-15T00:56:42.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119262025-01-15T00:56:42.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119272025-01-15T00:56:42.613ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.329823ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119282025-01-15T00:56:42.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119292025-01-15T00:56:42.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
119302025-01-15T00:56:42.618ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119312025-01-15T00:56:42.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119322025-01-15T00:56:42.630ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
119332025-01-15T00:56:42.630ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.228163ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
119342025-01-15T00:56:43.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8bdf7143-b06d-4405-b04f-f6338376a998 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119352025-01-15T00:56:43.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8bdf7143-b06d-4405-b04f-f6338376a998 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119362025-01-15T00:56:43.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8bdf7143-b06d-4405-b04f-f6338376a998 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119372025-01-15T00:56:44.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2c586532-c378-4402-9ad1-f12773c46c4a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119382025-01-15T00:56:44.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2c586532-c378-4402-9ad1-f12773c46c4a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119392025-01-15T00:56:44.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2c586532-c378-4402-9ad1-f12773c46c4a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119402025-01-15T00:56:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 526 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = b3fefa92-d3e6-4e01-9cbd-18cff5b585a0 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
119412025-01-15T00:56:45.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9b5bdca1-4069-427b-95d4-515fcbb1f894 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119422025-01-15T00:56:45.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9b5bdca1-4069-427b-95d4-515fcbb1f894 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119432025-01-15T00:56:45.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9b5bdca1-4069-427b-95d4-515fcbb1f894 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119442025-01-15T00:56:46.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3000882a-e7f4-46fa-9ea4-59c4ef932931 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119452025-01-15T00:56:46.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3000882a-e7f4-46fa-9ea4-59c4ef932931 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119462025-01-15T00:56:46.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1466 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3000882a-e7f4-46fa-9ea4-59c4ef932931 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119472025-01-15T00:56:47.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 040551fc-9a29-4c58-adb7-8601fdae343f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119482025-01-15T00:56:47.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 040551fc-9a29-4c58-adb7-8601fdae343f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119492025-01-15T00:56:47.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 040551fc-9a29-4c58-adb7-8601fdae343f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119502025-01-15T00:56:48.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e1b2dbc8-08b7-4efc-81d5-03c2259bd43d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119512025-01-15T00:56:48.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e1b2dbc8-08b7-4efc-81d5-03c2259bd43d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119522025-01-15T00:56:48.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2616 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e1b2dbc8-08b7-4efc-81d5-03c2259bd43d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119532025-01-15T00:56:48.519ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0d9a0363-dabd-427e-a7a7-b659411f1988 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2025-01-15T00:56:48.501998884Z }
119542025-01-15T00:56:48.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0d9a0363-dabd-427e-a7a7-b659411f1988 roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
119552025-01-15T00:56:48.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0d9a0363-dabd-427e-a7a7-b659411f1988 resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
119562025-01-15T00:56:48.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30130 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0d9a0363-dabd-427e-a7a7-b659411f1988 response_code = 204 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
119572025-01-15T00:56:49.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de465db6-c81e-4bb0-b506-90013cf3cd7e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119582025-01-15T00:56:49.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de465db6-c81e-4bb0-b506-90013cf3cd7e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119592025-01-15T00:56:49.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = de465db6-c81e-4bb0-b506-90013cf3cd7e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119602025-01-15T00:56:49.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 486b2f63-4fee-4467-8f09-cd9c2ba2882d roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
119612025-01-15T00:56:49.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 486b2f63-4fee-4467-8f09-cd9c2ba2882d resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
119622025-01-15T00:56:49.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3597 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 486b2f63-4fee-4467-8f09-cd9c2ba2882d response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
119632025-01-15T00:56:49.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 8a676bb9-56f3-4dc3-afa9-3dfaf31e41dd roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
119642025-01-15T00:56:49.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 8a676bb9-56f3-4dc3-afa9-3dfaf31e41dd resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
119652025-01-15T00:56:49.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2663 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 8a676bb9-56f3-4dc3-afa9-3dfaf31e41dd response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
119662025-01-15T00:56:50.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09e7e157-7248-4c7f-ad97-31f2132bfb12 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119672025-01-15T00:56:50.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09e7e157-7248-4c7f-ad97-31f2132bfb12 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119682025-01-15T00:56:50.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2542 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 09e7e157-7248-4c7f-ad97-31f2132bfb12 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119692025-01-15T00:56:51.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b3e422f-fd50-4fb2-86ca-272bc2665cb9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119702025-01-15T00:56:51.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b3e422f-fd50-4fb2-86ca-272bc2665cb9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119712025-01-15T00:56:51.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2b3e422f-fd50-4fb2-86ca-272bc2665cb9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119722025-01-15T00:56:52.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 29917cb0-81d5-488e-b1dd-f44c7c323a36 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119732025-01-15T00:56:52.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 29917cb0-81d5-488e-b1dd-f44c7c323a36 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119742025-01-15T00:56:52.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 29917cb0-81d5-488e-b1dd-f44c7c323a36 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
119752025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
119762025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
119772025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
119782025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
119792025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
119802025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
119812025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
119822025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
119832025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119842025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
119852025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
119862025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
119872025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
119882025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
119892025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
119902025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
119912025-01-15T00:56:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:46:52.603287324 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
119922025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
119932025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
119942025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
119952025-01-15T00:56:52.603ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
119962025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.88\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
119972025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
119982025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
119992025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120002025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120012025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
120022025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120032025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
120042025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120052025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120062025-01-15T00:56:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1632, tv_nsec: 933747470 } })
120072025-01-15T00:56:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120082025-01-15T00:56:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1632, tv_nsec: 933879193 } })
120092025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
120102025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.086971ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
120112025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
120122025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120132025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
120142025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120152025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
120162025-01-15T00:56:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
120172025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
120182025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
120192025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
120202025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120212025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120222025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
120232025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
120242025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
120252025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.158182ms iteration = 13 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
120262025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120272025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120282025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
120292025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120302025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120312025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120322025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
120332025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120342025-01-15T00:56:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120352025-01-15T00:56:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120362025-01-15T00:56:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120372025-01-15T00:56:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120382025-01-15T00:56:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120392025-01-15T00:56:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120402025-01-15T00:56:52.605ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
120412025-01-15T00:56:52.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
120422025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
120432025-01-15T00:56:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
120442025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
120452025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120462025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120472025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
120482025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
120492025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120502025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
120512025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.285582ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
120522025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
120532025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
120542025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
120552025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
120562025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
120572025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
120582025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120592025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120602025-01-15T00:56:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1632, tv_nsec: 937824819 } })
120612025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120622025-01-15T00:56:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
120632025-01-15T00:56:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120642025-01-15T00:56:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120652025-01-15T00:56:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
120662025-01-15T00:56:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
120672025-01-15T00:56:52.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1632, tv_nsec: 938003152 } })
120682025-01-15T00:56:52.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
120692025-01-15T00:56:52.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
120702025-01-15T00:56:52.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120712025-01-15T00:56:52.608ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:46:52.603287324 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
120722025-01-15T00:56:52.608ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.414754ms iteration = 13 status = {"expiration":"2025-01-15T00:46:52.603287324Z","pruned":[]}
120732025-01-15T00:56:52.608ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120742025-01-15T00:56:52.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120752025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120762025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
120772025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
120782025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
120792025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120802025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
120812025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120822025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
120832025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
120842025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
120852025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
120862025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
120872025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
120882025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
120892025-01-15T00:56:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
120902025-01-15T00:56:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120912025-01-15T00:56:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
120922025-01-15T00:56:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120932025-01-15T00:56:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
120942025-01-15T00:56:52.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120952025-01-15T00:56:52.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120962025-01-15T00:56:52.611ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
120972025-01-15T00:56:52.611ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120982025-01-15T00:56:52.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120992025-01-15T00:56:52.612ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
121002025-01-15T00:56:52.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121012025-01-15T00:56:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121022025-01-15T00:56:52.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121032025-01-15T00:56:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
121042025-01-15T00:56:52.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121052025-01-15T00:56:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121062025-01-15T00:56:52.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121072025-01-15T00:56:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121082025-01-15T00:56:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121092025-01-15T00:56:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
121102025-01-15T00:56:52.615ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
121112025-01-15T00:56:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
121122025-01-15T00:56:52.616ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121132025-01-15T00:56:52.617ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121142025-01-15T00:56:52.617ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121152025-01-15T00:56:52.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121162025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
121172025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121182025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121192025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
121202025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121212025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121222025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121232025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
121242025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121252025-01-15T00:56:52.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
121262025-01-15T00:56:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121272025-01-15T00:56:52.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
121282025-01-15T00:56:52.622ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121292025-01-15T00:56:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121302025-01-15T00:56:52.623ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
121312025-01-15T00:56:52.623ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
121322025-01-15T00:56:52.623ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
121332025-01-15T00:56:52.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121342025-01-15T00:56:52.623ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121352025-01-15T00:56:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121362025-01-15T00:56:52.625ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121372025-01-15T00:56:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121382025-01-15T00:56:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
121392025-01-15T00:56:52.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121402025-01-15T00:56:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121412025-01-15T00:56:52.625ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121422025-01-15T00:56:52.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121432025-01-15T00:56:52.626ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121442025-01-15T00:56:52.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121452025-01-15T00:56:52.628ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
121462025-01-15T00:56:52.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121472025-01-15T00:56:52.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121482025-01-15T00:56:52.628ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121492025-01-15T00:56:52.629ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
121502025-01-15T00:56:52.629ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
121512025-01-15T00:56:52.629ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121522025-01-15T00:56:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121532025-01-15T00:56:52.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
121542025-01-15T00:56:52.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121552025-01-15T00:56:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
121562025-01-15T00:56:52.630ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121572025-01-15T00:56:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121582025-01-15T00:56:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121592025-01-15T00:56:52.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121602025-01-15T00:56:52.631ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
121612025-01-15T00:56:52.631ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
121622025-01-15T00:56:52.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
121632025-01-15T00:56:52.637ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.622801ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
121642025-01-15T00:56:52.637ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121652025-01-15T00:56:52.637ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
121662025-01-15T00:56:52.637ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
121672025-01-15T00:56:52.637ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 28.125802ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
121682025-01-15T00:56:52.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121692025-01-15T00:56:52.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121702025-01-15T00:56:52.638ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121712025-01-15T00:56:52.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121722025-01-15T00:56:52.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121732025-01-15T00:56:52.639ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1632, tv_nsec: 968989679 } })
121742025-01-15T00:56:52.639ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
121752025-01-15T00:56:52.639ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121762025-01-15T00:56:52.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121772025-01-15T00:56:52.643ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 39.064352ms iteration = 6 status = {"nsuccess":5}
121782025-01-15T00:56:52.644ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121792025-01-15T00:56:52.647ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
121802025-01-15T00:56:52.647ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121812025-01-15T00:56:52.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121822025-01-15T00:56:52.672ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
121832025-01-15T00:56:52.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
121842025-01-15T00:56:52.679ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
121852025-01-15T00:56:52.679ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
121862025-01-15T00:56:52.679ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
121872025-01-15T00:56:52.679ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
121882025-01-15T00:56:52.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
121892025-01-15T00:56:52.680ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
121902025-01-15T00:56:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
121912025-01-15T00:56:52.681ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
121922025-01-15T00:56:52.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
121932025-01-15T00:56:52.681ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121942025-01-15T00:56:52.682ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 72.582737ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
121952025-01-15T00:56:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121962025-01-15T00:56:52.682ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
121972025-01-15T00:56:52.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
121982025-01-15T00:56:52.686ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121992025-01-15T00:56:52.686ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.314218ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
122002025-01-15T00:56:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
122012025-01-15T00:56:52.687ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.882637ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122022025-01-15T00:56:52.687ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
122032025-01-15T00:56:52.687ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
122042025-01-15T00:56:52.687ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.343684ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
122052025-01-15T00:56:52.688ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122062025-01-15T00:56:52.688ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122072025-01-15T00:56:52.690ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122082025-01-15T00:56:52.690ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122092025-01-15T00:56:52.690ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122102025-01-15T00:56:52.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122112025-01-15T00:56:52.692ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122122025-01-15T00:56:52.692ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
122132025-01-15T00:56:52.692ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122142025-01-15T00:56:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122152025-01-15T00:56:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
122162025-01-15T00:56:52.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122172025-01-15T00:56:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122182025-01-15T00:56:52.693ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
122192025-01-15T00:56:52.693ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122202025-01-15T00:56:52.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122212025-01-15T00:56:52.696ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122222025-01-15T00:56:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
122232025-01-15T00:56:52.698ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122242025-01-15T00:56:52.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
122252025-01-15T00:56:52.708ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
122262025-01-15T00:56:52.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
122272025-01-15T00:56:52.755ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
122282025-01-15T00:56:52.762ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
122292025-01-15T00:56:52.762ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122302025-01-15T00:56:52.763ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "482191e8-3672-4b3e-bba8-993d1642cf19", "content-length": "26", "date": "Wed, 15 Jan 2025 00:56:51 GMT"} })
122312025-01-15T00:56:52.763ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122322025-01-15T00:56:52.764ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122332025-01-15T00:56:52.777ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
122342025-01-15T00:56:52.777ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122352025-01-15T00:56:52.778ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a11a3e3b-4f46-40eb-92d1-5ae76078e334", "content-length": "26", "date": "Wed, 15 Jan 2025 00:56:51 GMT"} })
122362025-01-15T00:56:52.778ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122372025-01-15T00:56:52.780ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122382025-01-15T00:56:52.823ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
122392025-01-15T00:56:52.823ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122402025-01-15T00:56:52.823ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "45ac4d81-80e9-4c9e-91bb-0ef654da64a3", "content-length": "26", "date": "Wed, 15 Jan 2025 00:56:51 GMT"} })
122412025-01-15T00:56:52.824ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122422025-01-15T00:56:52.825ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
122432025-01-15T00:56:52.864ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
122442025-01-15T00:56:52.926ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 323.695649ms iteration = 25 status = {}
122452025-01-15T00:56:52.938ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
122462025-01-15T00:56:52.947ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1/state
122472025-01-15T00:56:52.948ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ab1fbdf-c5b3-4680-8aab-493a029c799f", "content-length": "130", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
122482025-01-15T00:56:52.953ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 5402056b-362a-490b-a804-8251b2b699f8 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2025-01-15T00:56:48.501998884Z }, migration_in: None, migration_out: None } vmm_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
122492025-01-15T00:56:52.953ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2077 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 vmm_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2025-01-15T00:56:48.501998884Z }
122502025-01-15T00:56:52.953ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 5402056b-362a-490b-a804-8251b2b699f8 roles = RoleSet { roles: {} } sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 vmm_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
122512025-01-15T00:56:52.953ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122522025-01-15T00:56:52.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 5402056b-362a-490b-a804-8251b2b699f8 resource = Database result = Ok(()) sled_id = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 vmm_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
122532025-01-15T00:56:52.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122542025-01-15T00:56:52.956ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122552025-01-15T00:56:52.957ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
122562025-01-15T00:56:52.958ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac9958c2-13c1-47a4-b784-b0757196c31b", "content-length": "1", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
122572025-01-15T00:56:52.959ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
122582025-01-15T00:56:52.959ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122592025-01-15T00:56:52.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122602025-01-15T00:56:52.960ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122612025-01-15T00:56:52.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122622025-01-15T00:56:52.969ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 366.30753ms iteration = 25 status = null
122632025-01-15T00:56:52.970ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 365.876151ms iteration = 25 status = 0
122642025-01-15T00:56:52.977ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
122652025-01-15T00:56:52.977ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 374.058698ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
122662025-01-15T00:56:52.989ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122672025-01-15T00:56:52.989ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122682025-01-15T00:56:52.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
122692025-01-15T00:56:52.992ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
122702025-01-15T00:56:52.992ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
122712025-01-15T00:56:52.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122722025-01-15T00:56:52.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122732025-01-15T00:56:52.992ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
122742025-01-15T00:56:52.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122752025-01-15T00:56:52.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122762025-01-15T00:56:52.994ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122772025-01-15T00:56:52.994ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122782025-01-15T00:56:52.994ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 387.288514ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
122792025-01-15T00:56:52.995ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122802025-01-15T00:56:52.995ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 385.866526ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
122812025-01-15T00:56:52.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122822025-01-15T00:56:52.996ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122832025-01-15T00:56:52.997ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
122842025-01-15T00:56:52.997ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 389.385964ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
122852025-01-15T00:56:52.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
122862025-01-15T00:56:52.997ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
122872025-01-15T00:56:52.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
122882025-01-15T00:56:52.997ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
122892025-01-15T00:56:52.997ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122902025-01-15T00:56:52.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122912025-01-15T00:56:53.004ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
122922025-01-15T00:56:53.004ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
122932025-01-15T00:56:53.004ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
122942025-01-15T00:56:53.004ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 401.770382ms iteration = 13 status = {"generation":2}
122952025-01-15T00:56:53.009ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
122962025-01-15T00:56:53.010ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7740ffa9-0ed1-41b7-97d4-a75509f215ad", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122972025-01-15T00:56:53.010ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122982025-01-15T00:56:53.010ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
122992025-01-15T00:56:53.012ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e5ea67b3-c497-4d57-ab85-c3f85714071c", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
123002025-01-15T00:56:53.012ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
123012025-01-15T00:56:53.013ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 405.561306ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
123022025-01-15T00:56:53.014ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
123032025-01-15T00:56:53.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 411.343727ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
123042025-01-15T00:56:53.023ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 413.772493ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
123052025-01-15T00:56:53.029ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
123062025-01-15T00:56:53.029ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e66cff12-be23-4cc3-86f8-9008f3a29232", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
123072025-01-15T00:56:53.029ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
123082025-01-15T00:56:53.031ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "40c3f95b-e9cb-4007-ba48-e9dd60249f44", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
123092025-01-15T00:56:53.031ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
123102025-01-15T00:56:53.033ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a3b40b01-c665-4900-972f-6fd1db81ddb2", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
123112025-01-15T00:56:53.033ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
123122025-01-15T00:56:53.035ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
123132025-01-15T00:56:53.035ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 432.253629ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
123142025-01-15T00:56:53.035ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123152025-01-15T00:56:53.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
123162025-01-15T00:56:53.037ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123172025-01-15T00:56:53.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123182025-01-15T00:56:53.038ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
123192025-01-15T00:56:53.038ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
123202025-01-15T00:56:53.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123212025-01-15T00:56:53.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123222025-01-15T00:56:53.040ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
123232025-01-15T00:56:53.040ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 436.437439ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
123242025-01-15T00:56:53.065ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
123252025-01-15T00:56:53.065ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 457.719869ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
123262025-01-15T00:56:53.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123272025-01-15T00:56:53.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123282025-01-15T00:56:53.067ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 462.899438ms iteration = 28 status = {"physical_disks_added":0}
123292025-01-15T00:56:53.069ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
123302025-01-15T00:56:53.069ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 466.805063ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
123312025-01-15T00:56:53.101ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
123322025-01-15T00:56:53.101ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123332025-01-15T00:56:53.101ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a525b128-452b-4ff1-bb81-0d7458de2628", "content-length": "585", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
123342025-01-15T00:56:53.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123352025-01-15T00:56:53.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123362025-01-15T00:56:53.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123372025-01-15T00:56:53.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123382025-01-15T00:56:53.107ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
123392025-01-15T00:56:53.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123402025-01-15T00:56:53.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123412025-01-15T00:56:53.120ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
123422025-01-15T00:56:53.120ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "90f36d61-5d3d-443c-ab93-f184b2f11910", "content-length": "134", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
123432025-01-15T00:56:53.120ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
123442025-01-15T00:56:53.120ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
123452025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
123462025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
123472025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123482025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123492025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123502025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123512025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123522025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123532025-01-15T00:56:53.121ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
123542025-01-15T00:56:53.121ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123552025-01-15T00:56:53.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123562025-01-15T00:56:53.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
123572025-01-15T00:56:53.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "066db78b-0acd-4101-bed3-33a838431e50", "content-length": "2", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
123582025-01-15T00:56:53.123ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
123592025-01-15T00:56:53.123ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4dab1816-238a-473c-b95a-47f8bffc5f41", "content-length": "51", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
123602025-01-15T00:56:53.123ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
123612025-01-15T00:56:53.123ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
123622025-01-15T00:56:53.136ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123632025-01-15T00:56:53.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
123642025-01-15T00:56:53.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123652025-01-15T00:56:53.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123662025-01-15T00:56:53.142ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
123672025-01-15T00:56:53.142ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
123682025-01-15T00:56:53.142ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
123692025-01-15T00:56:53.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 539.250628ms iteration = 13 status = {"generation":1}
123702025-01-15T00:56:53.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123712025-01-15T00:56:53.149ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {78f08dea-b6fa-401f-946b-11f0ea697d8a: {10.151.2.175: {acca3b44-1d46-4699-924a-31812b36b4ac}, 10.151.2.176: {acca3b44-1d46-4699-924a-31812b36b4ac}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
123722025-01-15T00:56:53.149ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123732025-01-15T00:56:53.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123742025-01-15T00:56:53.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123752025-01-15T00:56:53.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123762025-01-15T00:56:53.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123772025-01-15T00:56:53.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
123782025-01-15T00:56:53.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
123792025-01-15T00:56:53.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123802025-01-15T00:56:53.216ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a8a95fc2-0ef9-4709-938c-fd53bf954044", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
123812025-01-15T00:56:53.216ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
123822025-01-15T00:56:53.216ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
123832025-01-15T00:56:53.216ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fe2fbad9-a49e-4b83-a8bc-134201c8dcb2", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
123842025-01-15T00:56:53.216ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123852025-01-15T00:56:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123862025-01-15T00:56:53.217ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3fec67e2-edb2-439a-9478-daed23dafb40", "content-length": "682", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
123872025-01-15T00:56:53.217ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123882025-01-15T00:56:53.217ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123892025-01-15T00:56:53.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123902025-01-15T00:56:53.217ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "466fbb36-ec79-4d86-ab17-b8425d049624", "content-length": "811", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
123912025-01-15T00:56:53.217ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(14632636) }} sled = sock
123922025-01-15T00:56:53.217ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
123932025-01-15T00:56:53.217ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
123942025-01-15T00:56:53.218ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 610.768515ms iteration = 25 status = {}
123952025-01-15T00:56:53.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123962025-01-15T00:56:53.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123972025-01-15T00:56:53.221ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123982025-01-15T00:56:53.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123992025-01-15T00:56:53.223ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124002025-01-15T00:56:53.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124012025-01-15T00:56:53.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124022025-01-15T00:56:53.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124032025-01-15T00:56:53.226ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124042025-01-15T00:56:53.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124052025-01-15T00:56:53.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124062025-01-15T00:56:53.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124072025-01-15T00:56:53.229ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124082025-01-15T00:56:53.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124092025-01-15T00:56:53.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124102025-01-15T00:56:53.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124112025-01-15T00:56:53.234ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124122025-01-15T00:56:53.234ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
124132025-01-15T00:56:53.234ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
124142025-01-15T00:56:53.235ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 630.767579ms iteration = 25 status = {}
124152025-01-15T00:56:53.235ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "00fa40f7-8323-4c3e-8ddc-9bbf01c55160", "date": "Wed, 15 Jan 2025 00:56:52 GMT"} })
124162025-01-15T00:56:53.236ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 629.104187ms iteration = 25 status = {}
124172025-01-15T00:56:53.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85c32187-aad9-46a5-afd5-b2b14be27081 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124182025-01-15T00:56:53.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85c32187-aad9-46a5-afd5-b2b14be27081 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124192025-01-15T00:56:53.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85c32187-aad9-46a5-afd5-b2b14be27081 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124202025-01-15T00:56:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 627 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 6898c430-5d50-4f66-ad28-92530ecccc29 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
124212025-01-15T00:56:54.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 93c01205-f1e9-4263-a656-453ee4fa2f98 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124222025-01-15T00:56:54.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 93c01205-f1e9-4263-a656-453ee4fa2f98 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124232025-01-15T00:56:54.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2842 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 93c01205-f1e9-4263-a656-453ee4fa2f98 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124242025-01-15T00:56:55.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4eaa1d27-3cc4-445d-ba1d-75efab4258e4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124252025-01-15T00:56:55.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4eaa1d27-3cc4-445d-ba1d-75efab4258e4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124262025-01-15T00:56:55.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2634 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 4eaa1d27-3cc4-445d-ba1d-75efab4258e4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124272025-01-15T00:56:56.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8baacef0-ec87-4e7c-a959-2b2a50c0b537 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124282025-01-15T00:56:56.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8baacef0-ec87-4e7c-a959-2b2a50c0b537 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124292025-01-15T00:56:56.422ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3120 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8baacef0-ec87-4e7c-a959-2b2a50c0b537 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124302025-01-15T00:56:57.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8180f7fe-ad92-4abc-8a74-dc691d99a3db roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124312025-01-15T00:56:57.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8180f7fe-ad92-4abc-8a74-dc691d99a3db resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124322025-01-15T00:56:57.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2434 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8180f7fe-ad92-4abc-8a74-dc691d99a3db response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124332025-01-15T00:56:58.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88ef6748-7e22-4be9-bb81-c3a616b10c9b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124342025-01-15T00:56:58.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88ef6748-7e22-4be9-bb81-c3a616b10c9b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124352025-01-15T00:56:58.465ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 88ef6748-7e22-4be9-bb81-c3a616b10c9b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124362025-01-15T00:56:58.536ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72741a72-f61c-4a99-ae14-9e0fd7ae371e uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2025-01-15T00:56:58.535728274Z }
124372025-01-15T00:56:58.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72741a72-f61c-4a99-ae14-9e0fd7ae371e roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124382025-01-15T00:56:58.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72741a72-f61c-4a99-ae14-9e0fd7ae371e resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124392025-01-15T00:56:58.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44608 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 72741a72-f61c-4a99-ae14-9e0fd7ae371e response_code = 204 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124402025-01-15T00:56:59.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c052572c-6e1e-4e4c-b117-ec43d0c8d7d1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
124412025-01-15T00:56:59.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c052572c-6e1e-4e4c-b117-ec43d0c8d7d1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
124422025-01-15T00:56:59.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2876 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = c052572c-6e1e-4e4c-b117-ec43d0c8d7d1 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
124432025-01-15T00:56:59.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 7f65cdd9-cfb7-4089-8ceb-e9d9f02c68a1 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
124442025-01-15T00:56:59.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 7f65cdd9-cfb7-4089-8ceb-e9d9f02c68a1 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
124452025-01-15T00:56:59.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3573 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 7f65cdd9-cfb7-4089-8ceb-e9d9f02c68a1 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
124462025-01-15T00:56:59.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e219db2a-a3a3-4f74-bc30-2c0ac1633f4b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124472025-01-15T00:56:59.486ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e219db2a-a3a3-4f74-bc30-2c0ac1633f4b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124482025-01-15T00:56:59.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2360 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e219db2a-a3a3-4f74-bc30-2c0ac1633f4b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124492025-01-15T00:57:00.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fea4217b-ae74-4f8e-9592-1bc71b49566f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124502025-01-15T00:57:00.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fea4217b-ae74-4f8e-9592-1bc71b49566f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124512025-01-15T00:57:00.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1708 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fea4217b-ae74-4f8e-9592-1bc71b49566f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
124522025-01-15T00:57:01.044ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-15T00:57:01.043790362Z }
124532025-01-15T00:57:01.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124542025-01-15T00:57:01.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124552025-01-15T00:57:01.066ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 vmm_needs_update = true
124562025-01-15T00:57:01.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124572025-01-15T00:57:01.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124582025-01-15T00:57:01.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124592025-01-15T00:57:01.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124602025-01-15T00:57:01.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124612025-01-15T00:57:01.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124622025-01-15T00:57:01.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124632025-01-15T00:57:01.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124642025-01-15T00:57:01.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124652025-01-15T00:57:01.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124662025-01-15T00:57:01.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124672025-01-15T00:57:01.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124682025-01-15T00:57:01.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8f19ac38-9ab2-4355-b6b6-206831e8e12a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
124692025-01-15T00:57:01.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8f19ac38-9ab2-4355-b6b6-206831e8e12a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
124702025-01-15T00:57:01.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 8f19ac38-9ab2-4355-b6b6-206831e8e12a response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
124712025-01-15T00:57:01.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124722025-01-15T00:57:01.168ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, lookup_type: ById(5cb90e2d-bd32-442c-b5f9-1259cc451f17) }, key: 6752adb0-3b6d-4d0a-88ac-3a4b8f359936, lookup_type: ById(6752adb0-3b6d-4d0a-88ac-3a4b8f359936) }, key: 5402056b-362a-490b-a804-8251b2b699f8, lookup_type: ById(5402056b-362a-490b-a804-8251b2b699f8) } result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124732025-01-15T00:57:01.181ZINFOnexus (dropshot_internal): starting update saga for 5402056b-362a-490b-a804-8251b2b699f8 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1544 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-15T00:57:01.043790362Z }
124742025-01-15T00:57:01.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137604 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 response_code = 204 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124752025-01-15T00:57:01.181ZDEBGnexus (dropshot_internal): preparing instance-update saga for 5402056b-362a-490b-a804-8251b2b699f8... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 5402056b-362a-490b-a804-8251b2b699f8 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e5be424f-e5ff-4756-ab6c-5f2b96bb2545 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124762025-01-15T00:57:01.182ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2077 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d2c8c953-b4e7-4378-bb83-723a95393dec uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-15T00:57:01.043790362Z }
124772025-01-15T00:57:01.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d2c8c953-b4e7-4378-bb83-723a95393dec roles = RoleSet { roles: {} } uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124782025-01-15T00:57:01.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d2c8c953-b4e7-4378-bb83-723a95393dec resource = Database result = Ok(()) uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124792025-01-15T00:57:01.184ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update
124802025-01-15T00:57:01.186ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"5402056b-362a-490b-a804-8251b2b699f8","lookup_type":{"ById":"5402056b-362a-490b-a804-8251b2b699f8"},"parent":{"key":"6752adb0-3b6d-4d0a-88ac-3a4b8f359936","lookup_type":{"ById":"6752adb0-3b6d-4d0a-88ac-3a4b8f359936"},"parent":{"key":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","lookup_type":{"ById":"5cb90e2d-bd32-442c-b5f9-1259cc451f17"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
124812025-01-15T00:57:01.186ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update
124822025-01-15T00:57:01.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46798 local_addr = [fd00:1122:3344:101::a]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d2c8c953-b4e7-4378-bb83-723a95393dec response_code = 204 uri = /vmms/a1e1883e-81d0-4783-8ebb-3217ac4a3dd1
124832025-01-15T00:57:01.235ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update
124842025-01-15T00:57:01.238ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
124852025-01-15T00:57:01.249ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
124862025-01-15T00:57:01.249ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
124872025-01-15T00:57:01.256ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
124882025-01-15T00:57:01.256ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
124892025-01-15T00:57:01.261ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
124902025-01-15T00:57:01.261ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
124912025-01-15T00:57:01.275ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
124922025-01-15T00:57:01.275ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("5e96510d-6646-4dda-bb17-d3b73d250aaf")) node_id = 0 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
124932025-01-15T00:57:01.282ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
124942025-01-15T00:57:01.282ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
124952025-01-15T00:57:01.302ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update
124962025-01-15T00:57:01.304ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
124972025-01-15T00:57:01.304ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
124982025-01-15T00:57:01.306ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
124992025-01-15T00:57:01.307ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125002025-01-15T00:57:01.309ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125012025-01-15T00:57:01.309ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125022025-01-15T00:57:01.310ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125032025-01-15T00:57:01.311ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125042025-01-15T00:57:01.343ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125052025-01-15T00:57:01.343ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125062025-01-15T00:57:01.345ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125072025-01-15T00:57:01.345ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125082025-01-15T00:57:01.346ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125092025-01-15T00:57:01.350ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, lookup_type: ById(5cb90e2d-bd32-442c-b5f9-1259cc451f17) }, key: 6752adb0-3b6d-4d0a-88ac-3a4b8f359936, lookup_type: ById(6752adb0-3b6d-4d0a-88ac-3a4b8f359936) }, key: 5402056b-362a-490b-a804-8251b2b699f8, lookup_type: ById(5402056b-362a-490b-a804-8251b2b699f8) } result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125102025-01-15T00:57:01.350ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance updater_id = 5e96510d-6646-4dda-bb17-d3b73d250aaf
125112025-01-15T00:57:01.350ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125122025-01-15T00:57:01.350ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125132025-01-15T00:57:01.372ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance updater_id = 5e96510d-6646-4dda-bb17-d3b73d250aaf
125142025-01-15T00:57:01.372ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125152025-01-15T00:57:01.372ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance
125162025-01-15T00:57:01.379ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 5402056b-362a-490b-a804-8251b2b699f8 locked_gen = Generation(Generation(2)) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = LockInstance updater_id = 5e96510d-6646-4dda-bb17-d3b73d250aaf
125172025-01-15T00:57:01.381ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125182025-01-15T00:57:01.381ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5e96510d-6646-4dda-bb17-d3b73d250aaf")}) node_id = 1 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
125192025-01-15T00:57:01.395ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125202025-01-15T00:57:01.395ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
125212025-01-15T00:57:01.413ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125222025-01-15T00:57:01.413ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125232025-01-15T00:57:01.414ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125242025-01-15T00:57:01.415ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125252025-01-15T00:57:01.416ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125262025-01-15T00:57:01.416ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125272025-01-15T00:57:01.418ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125282025-01-15T00:57:01.421ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, lookup_type: ById(5cb90e2d-bd32-442c-b5f9-1259cc451f17) }, key: 6752adb0-3b6d-4d0a-88ac-3a4b8f359936, lookup_type: ById(6752adb0-3b6d-4d0a-88ac-3a4b8f359936) }, key: 5402056b-362a-490b-a804-8251b2b699f8, lookup_type: ById(5402056b-362a-490b-a804-8251b2b699f8) } result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125292025-01-15T00:57:01.421ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125302025-01-15T00:57:01.421ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
125312025-01-15T00:57:01.433ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: a1e1883e-81d0-4783-8ebb-3217ac4a3dd1, time_created: 2025-01-15T00:56:40.287541Z, time_deleted: None, instance_id: 5402056b-362a-490b-a804-8251b2b699f8, sled_id: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-01-15T00:57:01.043790Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-01-15T00:56:38.068705Z, gen: Generation(Generation(3)), propolis_id: Some(a1e1883e-81d0-4783-8ebb-3217ac4a3dd1), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-01-15T00:57:01.433092923Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
125322025-01-15T00:57:01.440ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
125332025-01-15T00:57:01.440ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"5402056b-362a-490b-a804-8251b2b699f8","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"a1e1883e-81d0-4783-8ebb-3217ac4a3dd1"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"5402056b-362a-490b-a804-8251b2b699f8","lookup_type":{"ById":"5402056b-362a-490b-a804-8251b2b699f8"},"parent":{"key":"6752adb0-3b6d-4d0a-88ac-3a4b8f359936","lookup_type":{"ById":"6752adb0-3b6d-4d0a-88ac-3a4b8f359936"},"parent":{"key":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","lookup_type":{"ById":"5cb90e2d-bd32-442c-b5f9-1259cc451f17"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"5e96510d-6646-4dda-bb17-d3b73d250aaf"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"6752adb0-3b6d-4d0a-88ac-3a4b8f359936","ram_diff":1073741824},"destroy_active_vmm":"a1e1883e-81d0-4783-8ebb-3217ac4a3dd1","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-01-15T00:57:01.433092923Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125342025-01-15T00:57:01.440ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
125352025-01-15T00:57:01.453ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
125362025-01-15T00:57:01.453ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125372025-01-15T00:57:01.453ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125382025-01-15T00:57:01.453ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125392025-01-15T00:57:01.457ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125402025-01-15T00:57:01.457ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125412025-01-15T00:57:01.465ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125422025-01-15T00:57:01.465ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125432025-01-15T00:57:01.469ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125442025-01-15T00:57:01.469ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("0e8ce5a5-f199-4291-b87d-89dd919c75fb")) node_id = 0 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125452025-01-15T00:57:01.476ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125462025-01-15T00:57:01.476ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125472025-01-15T00:57:01.491ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 5402056b-362a-490b-a804-8251b2b699f8 parent_lock = UpdaterLock { updater_id: 5e96510d-6646-4dda-bb17-d3b73d250aaf, locked_gen: Generation(Generation(2)) } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
125482025-01-15T00:57:01.492ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = BecomeUpdater
125492025-01-15T00:57:01.492ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = BecomeUpdater
125502025-01-15T00:57:01.513ZDEBGnexus (SagaExecutor): inherited lock from 5e96510d-6646-4dda-bb17-d3b73d250aaf to 0e8ce5a5-f199-4291-b87d-89dd919c75fb actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 5402056b-362a-490b-a804-8251b2b699f8 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 5e96510d-6646-4dda-bb17-d3b73d250aaf saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = BecomeUpdater updater_id = 0e8ce5a5-f199-4291-b87d-89dd919c75fb
125512025-01-15T00:57:01.513ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
125522025-01-15T00:57:01.513ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125532025-01-15T00:57:01.513ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("0e8ce5a5-f199-4291-b87d-89dd919c75fb")}) node_id = 1 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125542025-01-15T00:57:01.521ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125552025-01-15T00:57:01.521ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125562025-01-15T00:57:01.527ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125572025-01-15T00:57:01.527ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125582025-01-15T00:57:01.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4b46221-af71-4d3a-a8fc-f7e722fa663f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
125592025-01-15T00:57:01.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4b46221-af71-4d3a-a8fc-f7e722fa663f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
125602025-01-15T00:57:01.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1328 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b4b46221-af71-4d3a-a8fc-f7e722fa663f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
125612025-01-15T00:57:01.534ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125622025-01-15T00:57:01.534ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125632025-01-15T00:57:01.544ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
125642025-01-15T00:57:01.546ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 5402056b-362a-490b-a804-8251b2b699f8
125652025-01-15T00:57:01.546ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UpdateNetworkConfig
125662025-01-15T00:57:01.547ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UpdateNetworkConfig
125672025-01-15T00:57:01.556ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UpdateNetworkConfig
125682025-01-15T00:57:01.557ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UpdateNetworkConfig
125692025-01-15T00:57:01.559ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
125702025-01-15T00:57:01.559ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UpdateNetworkConfig
125712025-01-15T00:57:01.559ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UpdateNetworkConfig
125722025-01-15T00:57:01.561ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
125732025-01-15T00:57:01.561ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
125742025-01-15T00:57:01.561ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
125752025-01-15T00:57:01.562ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
125762025-01-15T00:57:01.564ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
125772025-01-15T00:57:01.564ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
125782025-01-15T00:57:01.564ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
125792025-01-15T00:57:01.576ZDEBGnexus: notifying dendrite of updates instance_id = Some(5402056b-362a-490b-a804-8251b2b699f8 (instance)) switch = switch0
125802025-01-15T00:57:01.576ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1641, tv_nsec: 906823237 } })
125812025-01-15T00:57:01.577ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1104
125822025-01-15T00:57:01.607ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
125832025-01-15T00:57:01.607ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125842025-01-15T00:57:01.607ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b43bf932-7e42-489d-ac03-48b7f26c306e", "content-length": "26", "date": "Wed, 15 Jan 2025 00:57:01 GMT"} })
125852025-01-15T00:57:01.607ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125862025-01-15T00:57:01.608ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125872025-01-15T00:57:01.637ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
125882025-01-15T00:57:01.637ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "ba0a3614-138f-4359-ac59-7712ca31d448", "content-length": "4", "date": "Wed, 15 Jan 2025 00:57:01 GMT"} })
125892025-01-15T00:57:01.639ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125902025-01-15T00:57:01.639ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125912025-01-15T00:57:01.651ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125922025-01-15T00:57:01.651ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125932025-01-15T00:57:01.659ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
125942025-01-15T00:57:01.659ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
125952025-01-15T00:57:01.766ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-01-15T00:57:01.683728Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, time_modified: Some(2025-01-15T00:57:01.683728Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 6752adb0-3b6d-4d0a-88ac-3a4b8f359936, time_modified: Some(2025-01-15T00:57:01.683728Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
125962025-01-15T00:57:01.766ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125972025-01-15T00:57:01.766ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
125982025-01-15T00:57:01.777ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
125992025-01-15T00:57:01.777ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126002025-01-15T00:57:01.784ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126012025-01-15T00:57:01.784ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UnassignOximeterProducer
126022025-01-15T00:57:01.785ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UnassignOximeterProducer
126032025-01-15T00:57:01.793ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = dee7453b-558a-4d94-b6a0-8b27cb27f002 producer_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126042025-01-15T00:57:01.793ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UnassignOximeterProducer
126052025-01-15T00:57:01.793ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = UnassignOximeterProducer
126062025-01-15T00:57:01.838ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126072025-01-15T00:57:01.848ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/5402056b-362a-490b-a804-8251b2b699f8
126082025-01-15T00:57:01.858ZDEBGnexus (SagaExecutor): client response oximeter-collector = 5402056b-362a-490b-a804-8251b2b699f8 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/5402056b-362a-490b-a804-8251b2b699f8", status: 204, headers: {"x-request-id": "75e402d9-5a9e-4a78-a17a-eff5b1e6ed32", "date": "Wed, 15 Jan 2025 00:57:01 GMT"} }) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126092025-01-15T00:57:01.859ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = dee7453b-558a-4d94-b6a0-8b27cb27f002 producer_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126102025-01-15T00:57:01.860ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126112025-01-15T00:57:01.860ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126122025-01-15T00:57:01.865ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126132025-01-15T00:57:01.865ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126142025-01-15T00:57:01.868ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 5402056b-362a-490b-a804-8251b2b699f8 lock = UpdaterLock { updater_id: 0e8ce5a5-f199-4291-b87d-89dd919c75fb, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2025-01-15T00:57:01.433092923Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126152025-01-15T00:57:01.868ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = CommitInstanceUpdates
126162025-01-15T00:57:01.868ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = CommitInstanceUpdates
126172025-01-15T00:57:01.917ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 new_runtime = InstanceRuntimeState { time_updated: 2025-01-15T00:57:01.433092923Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126182025-01-15T00:57:01.917ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126192025-01-15T00:57:01.917ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126202025-01-15T00:57:01.917ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Signaled
126212025-01-15T00:57:01.917ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126222025-01-15T00:57:01.917ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Signaled
126232025-01-15T00:57:01.917ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
126242025-01-15T00:57:01.917ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126252025-01-15T00:57:01.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126262025-01-15T00:57:01.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126272025-01-15T00:57:01.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126282025-01-15T00:57:01.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
126292025-01-15T00:57:01.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126302025-01-15T00:57:01.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126312025-01-15T00:57:01.922ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126322025-01-15T00:57:01.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
126332025-01-15T00:57:01.924ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126342025-01-15T00:57:01.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126352025-01-15T00:57:01.929ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126362025-01-15T00:57:01.929ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126372025-01-15T00:57:01.936ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126382025-01-15T00:57:01.936ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("5402056b-362a-490b-a804-8251b2b699f8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a1e1883e-81d0-4783-8ebb-3217ac4a3dd1")}) node_id = 7 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126392025-01-15T00:57:01.943ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126402025-01-15T00:57:01.943ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126412025-01-15T00:57:01.948ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126422025-01-15T00:57:01.948ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126432025-01-15T00:57:01.955ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126442025-01-15T00:57:01.955ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126452025-01-15T00:57:01.967ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126462025-01-15T00:57:01.967ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ReleaseSledResources
126472025-01-15T00:57:01.967ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ReleaseSledResources
126482025-01-15T00:57:01.975ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126492025-01-15T00:57:01.975ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126502025-01-15T00:57:01.986ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126512025-01-15T00:57:01.986ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126522025-01-15T00:57:01.990ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 propolis_id = a1e1883e-81d0-4783-8ebb-3217ac4a3dd1 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
126532025-01-15T00:57:01.990ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = MarkVmmDeleted
126542025-01-15T00:57:01.990ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = MarkVmmDeleted
126552025-01-15T00:57:02.018ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
126562025-01-15T00:57:02.018ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126572025-01-15T00:57:02.018ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126582025-01-15T00:57:02.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126592025-01-15T00:57:02.019ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3824e43c-68a8-44a9-8c72-fb49017b986a", "content-length": "372", "date": "Wed, 15 Jan 2025 00:57:02 GMT"} })
126602025-01-15T00:57:02.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126612025-01-15T00:57:02.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126622025-01-15T00:57:02.043ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126632025-01-15T00:57:02.043ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126642025-01-15T00:57:02.050ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
126652025-01-15T00:57:02.050ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
126662025-01-15T00:57:02.050ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1731c6b2-89a3-47f6-92dc-b97dc1a02eb9", "date": "Wed, 15 Jan 2025 00:57:02 GMT"} })
126672025-01-15T00:57:02.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126682025-01-15T00:57:02.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126692025-01-15T00:57:02.053ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126702025-01-15T00:57:02.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126712025-01-15T00:57:02.055ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126722025-01-15T00:57:02.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126732025-01-15T00:57:02.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126742025-01-15T00:57:02.056ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126752025-01-15T00:57:02.056ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126762025-01-15T00:57:02.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126772025-01-15T00:57:02.060ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
126782025-01-15T00:57:02.060ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126792025-01-15T00:57:02.060ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126802025-01-15T00:57:02.060ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126812025-01-15T00:57:02.060ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bc9d4b96-c567-46e1-a756-8f072f1d4ba0", "date": "Wed, 15 Jan 2025 00:57:02 GMT"} })
126822025-01-15T00:57:02.062ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 144.91446ms iteration = 26 status = {}
126832025-01-15T00:57:02.071ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
126842025-01-15T00:57:02.071ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
126852025-01-15T00:57:02.079ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126862025-01-15T00:57:02.079ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126872025-01-15T00:57:02.080ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126882025-01-15T00:57:02.080ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126892025-01-15T00:57:02.082ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126902025-01-15T00:57:02.082ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126912025-01-15T00:57:02.083ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126922025-01-15T00:57:02.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126932025-01-15T00:57:02.087ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
126942025-01-15T00:57:02.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
126952025-01-15T00:57:02.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
126962025-01-15T00:57:02.087ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, lookup_type: ById(5cb90e2d-bd32-442c-b5f9-1259cc451f17) }, key: 6752adb0-3b6d-4d0a-88ac-3a4b8f359936, lookup_type: ById(6752adb0-3b6d-4d0a-88ac-3a4b8f359936) }, key: 5402056b-362a-490b-a804-8251b2b699f8, lookup_type: ById(5402056b-362a-490b-a804-8251b2b699f8) } result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126972025-01-15T00:57:02.087ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126982025-01-15T00:57:02.087ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_node = ChainSuccessorSaga
126992025-01-15T00:57:02.088ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127002025-01-15T00:57:02.090ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
127012025-01-15T00:57:02.090ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127022025-01-15T00:57:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127032025-01-15T00:57:02.092ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 5402056b-362a-490b-a804-8251b2b699f8 karmic_state = WillReincarnate needs_reincarnation = false saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update
127042025-01-15T00:57:02.092ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127052025-01-15T00:57:02.092ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
127062025-01-15T00:57:02.102ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127072025-01-15T00:57:02.102ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
127082025-01-15T00:57:02.108ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127092025-01-15T00:57:02.108ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
127102025-01-15T00:57:02.113ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127112025-01-15T00:57:02.113ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92
127122025-01-15T00:57:02.123ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
127132025-01-15T00:57:02.123ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "18e5acc6-f157-4659-9187-4cad740f6930", "content-length": "691", "date": "Wed, 15 Jan 2025 00:57:02 GMT"} })
127142025-01-15T00:57:02.123ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
127152025-01-15T00:57:02.123ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
127162025-01-15T00:57:02.123ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
127172025-01-15T00:57:02.125ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 207.817249ms iteration = 26 status = {}
127182025-01-15T00:57:02.136ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127192025-01-15T00:57:02.136ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 saga_name = instance-update saga_result = SagaResult { saga_id: 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92, saga_log: SagaLog { saga_id: 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("0e8ce5a5-f199-4291-b87d-89dd919c75fb")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("0e8ce5a5-f199-4291-b87d-89dd919c75fb")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("5402056b-362a-490b-a804-8251b2b699f8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a1e1883e-81d0-4783-8ebb-3217ac4a3dd1")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("5402056b-362a-490b-a804-8251b2b699f8"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("a1e1883e-81d0-4783-8ebb-3217ac4a3dd1")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("0e8ce5a5-f199-4291-b87d-89dd919c75fb"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("0e8ce5a5-f199-4291-b87d-89dd919c75fb")}} }) }
127202025-01-15T00:57:02.136ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 9e64f4b3-68e9-4179-9d6d-51a7e1b78f92 instance_id = 5402056b-362a-490b-a804-8251b2b699f8 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update
127212025-01-15T00:57:02.136ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127222025-01-15T00:57:02.136ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
127232025-01-15T00:57:02.144ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127242025-01-15T00:57:02.144ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
127252025-01-15T00:57:02.151ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127262025-01-15T00:57:02.151ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
127272025-01-15T00:57:02.155ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127282025-01-15T00:57:02.155ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d
127292025-01-15T00:57:02.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0ff978cc-17e8-4833-bbfa-080d8d1bfbf8 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
127302025-01-15T00:57:02.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0ff978cc-17e8-4833-bbfa-080d8d1bfbf8 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
127312025-01-15T00:57:02.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3202 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 0ff978cc-17e8-4833-bbfa-080d8d1bfbf8 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
127322025-01-15T00:57:02.195ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update sec_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127332025-01-15T00:57:02.195ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 369d86e4-57cd-47f6-b981-5a61dd48b98d saga_name = start-instance-update saga_result = SagaResult { saga_id: 369d86e4-57cd-47f6-b981-5a61dd48b98d, saga_log: SagaLog { saga_id: 369d86e4-57cd-47f6-b981-5a61dd48b98d, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("5e96510d-6646-4dda-bb17-d3b73d250aaf")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("5e96510d-6646-4dda-bb17-d3b73d250aaf")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("5e96510d-6646-4dda-bb17-d3b73d250aaf"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("5e96510d-6646-4dda-bb17-d3b73d250aaf")}} }) }
127342025-01-15T00:57:02.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 802923b0-4103-4356-b29b-86fd9bffd8da roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127352025-01-15T00:57:02.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 802923b0-4103-4356-b29b-86fd9bffd8da resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127362025-01-15T00:57:02.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2311 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 802923b0-4103-4356-b29b-86fd9bffd8da response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127372025-01-15T00:57:02.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
127382025-01-15T00:57:02.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127392025-01-15T00:57:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127402025-01-15T00:57:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127412025-01-15T00:57:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
127422025-01-15T00:57:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127432025-01-15T00:57:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127442025-01-15T00:57:02.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
127452025-01-15T00:57:02.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127462025-01-15T00:57:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127472025-01-15T00:57:02.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127482025-01-15T00:57:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127492025-01-15T00:57:02.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127502025-01-15T00:57:02.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
127512025-01-15T00:57:02.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127522025-01-15T00:57:02.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127532025-01-15T00:57:02.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
127542025-01-15T00:57:02.626ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.052604ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
127552025-01-15T00:57:02.635ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127562025-01-15T00:57:02.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127572025-01-15T00:57:02.637ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.418016ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
127582025-01-15T00:57:03.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 33f4779a-a867-44c5-a43e-47ad5b5c9397 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
127592025-01-15T00:57:03.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 33f4779a-a867-44c5-a43e-47ad5b5c9397 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
127602025-01-15T00:57:03.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2626 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 33f4779a-a867-44c5-a43e-47ad5b5c9397 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
127612025-01-15T00:57:03.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cb48c1a8-cdcb-4808-9073-1030ade6594d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127622025-01-15T00:57:03.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cb48c1a8-cdcb-4808-9073-1030ade6594d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127632025-01-15T00:57:03.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1967 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = cb48c1a8-cdcb-4808-9073-1030ade6594d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127642025-01-15T00:57:04.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 3f1bdc41-ffcc-4a5a-baea-8d89823fb86f roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
127652025-01-15T00:57:04.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 3f1bdc41-ffcc-4a5a-baea-8d89823fb86f resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
127662025-01-15T00:57:04.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3661 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 3f1bdc41-ffcc-4a5a-baea-8d89823fb86f response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
127672025-01-15T00:57:04.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 3890ba95-511f-44f2-8799-4933cfad9dd2 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
127682025-01-15T00:57:04.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 3890ba95-511f-44f2-8799-4933cfad9dd2 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
127692025-01-15T00:57:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 611 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = b23dc934-4383-4360-b9c0-1a044aa9f6f6 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
127702025-01-15T00:57:04.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2999 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 3890ba95-511f-44f2-8799-4933cfad9dd2 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
127712025-01-15T00:57:04.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c7d9ed7c-33cd-4962-ab95-b8cd668f3516 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127722025-01-15T00:57:04.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c7d9ed7c-33cd-4962-ab95-b8cd668f3516 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127732025-01-15T00:57:04.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c7d9ed7c-33cd-4962-ab95-b8cd668f3516 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127742025-01-15T00:57:05.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 48729bdb-262f-4d01-80a3-6c83b021a05d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127752025-01-15T00:57:05.620ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 48729bdb-262f-4d01-80a3-6c83b021a05d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127762025-01-15T00:57:05.622ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 48729bdb-262f-4d01-80a3-6c83b021a05d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127772025-01-15T00:57:06.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eb145fd1-c23f-4f07-b896-7dbc080c37f4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127782025-01-15T00:57:06.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eb145fd1-c23f-4f07-b896-7dbc080c37f4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127792025-01-15T00:57:06.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = eb145fd1-c23f-4f07-b896-7dbc080c37f4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127802025-01-15T00:57:07.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b08fef5-e687-40d6-bc59-945adf91de5b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127812025-01-15T00:57:07.663ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b08fef5-e687-40d6-bc59-945adf91de5b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127822025-01-15T00:57:07.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3b08fef5-e687-40d6-bc59-945adf91de5b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127832025-01-15T00:57:08.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f51c6400-9246-494e-b549-89d0b2e5faad roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127842025-01-15T00:57:08.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f51c6400-9246-494e-b549-89d0b2e5faad resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127852025-01-15T00:57:08.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = f51c6400-9246-494e-b549-89d0b2e5faad response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127862025-01-15T00:57:09.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8608860-c392-4e80-b9e4-c73bdbfe3e5d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127872025-01-15T00:57:09.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8608860-c392-4e80-b9e4-c73bdbfe3e5d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127882025-01-15T00:57:09.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e8608860-c392-4e80-b9e4-c73bdbfe3e5d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127892025-01-15T00:57:10.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fc2324fe-cb92-4d39-9cf7-6c00dfe7e7fc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127902025-01-15T00:57:10.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fc2324fe-cb92-4d39-9cf7-6c00dfe7e7fc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127912025-01-15T00:57:10.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fc2324fe-cb92-4d39-9cf7-6c00dfe7e7fc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127922025-01-15T00:57:11.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8ccd7af5-b133-4f57-b8ff-2b6d34a5084c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127932025-01-15T00:57:11.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8ccd7af5-b133-4f57-b8ff-2b6d34a5084c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127942025-01-15T00:57:11.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8ccd7af5-b133-4f57-b8ff-2b6d34a5084c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
127952025-01-15T00:57:12.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
127962025-01-15T00:57:12.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127972025-01-15T00:57:12.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127982025-01-15T00:57:12.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127992025-01-15T00:57:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128002025-01-15T00:57:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128012025-01-15T00:57:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128022025-01-15T00:57:12.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
128032025-01-15T00:57:12.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128042025-01-15T00:57:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128052025-01-15T00:57:12.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128062025-01-15T00:57:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128072025-01-15T00:57:12.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128082025-01-15T00:57:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128092025-01-15T00:57:12.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128102025-01-15T00:57:12.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.11238ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128112025-01-15T00:57:12.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
128122025-01-15T00:57:12.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128132025-01-15T00:57:12.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128142025-01-15T00:57:12.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
128152025-01-15T00:57:12.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.132935ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
128162025-01-15T00:57:12.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1fcddb76-34e0-4994-8b17-4aa6170ca2ad roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128172025-01-15T00:57:12.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1fcddb76-34e0-4994-8b17-4aa6170ca2ad resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128182025-01-15T00:57:12.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2117 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1fcddb76-34e0-4994-8b17-4aa6170ca2ad response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128192025-01-15T00:57:13.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 66ea1de2-10c7-49dc-bd55-a0de8bedbf8d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128202025-01-15T00:57:13.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 66ea1de2-10c7-49dc-bd55-a0de8bedbf8d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128212025-01-15T00:57:13.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 66ea1de2-10c7-49dc-bd55-a0de8bedbf8d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128222025-01-15T00:57:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 623 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 2c5d7d85-08dd-495f-8b06-9231870fe015 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
128232025-01-15T00:57:14.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 36819e0c-5654-4fee-b1c4-fedc84033cc9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128242025-01-15T00:57:14.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 36819e0c-5654-4fee-b1c4-fedc84033cc9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128252025-01-15T00:57:14.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 36819e0c-5654-4fee-b1c4-fedc84033cc9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128262025-01-15T00:57:15.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 65633fa2-233a-4545-a8c2-e5e2f74e1472 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128272025-01-15T00:57:15.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 65633fa2-233a-4545-a8c2-e5e2f74e1472 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128282025-01-15T00:57:15.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2500 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 65633fa2-233a-4545-a8c2-e5e2f74e1472 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128292025-01-15T00:57:16.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41254306-8ee0-477e-a28b-f52b45a99d64 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128302025-01-15T00:57:16.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41254306-8ee0-477e-a28b-f52b45a99d64 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128312025-01-15T00:57:16.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2063 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41254306-8ee0-477e-a28b-f52b45a99d64 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128322025-01-15T00:57:17.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab013132-d52e-40bc-ae20-5320b046301e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128332025-01-15T00:57:17.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab013132-d52e-40bc-ae20-5320b046301e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128342025-01-15T00:57:17.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab013132-d52e-40bc-ae20-5320b046301e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128352025-01-15T00:57:18.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7180ef4f-370c-4a4a-aaf7-0ddb341e453c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128362025-01-15T00:57:18.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7180ef4f-370c-4a4a-aaf7-0ddb341e453c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128372025-01-15T00:57:18.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7180ef4f-370c-4a4a-aaf7-0ddb341e453c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128382025-01-15T00:57:19.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dca228b0-8415-483e-aa46-1126ee6b7b6f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128392025-01-15T00:57:19.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dca228b0-8415-483e-aa46-1126ee6b7b6f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128402025-01-15T00:57:19.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2441 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = dca228b0-8415-483e-aa46-1126ee6b7b6f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128412025-01-15T00:57:20.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7c637498-9bf5-4317-97fd-a06a9308709d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128422025-01-15T00:57:20.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7c637498-9bf5-4317-97fd-a06a9308709d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128432025-01-15T00:57:20.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7c637498-9bf5-4317-97fd-a06a9308709d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128442025-01-15T00:57:21.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ccce385f-64b3-476c-a3e9-0c3e2d24cbfb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128452025-01-15T00:57:21.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ccce385f-64b3-476c-a3e9-0c3e2d24cbfb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128462025-01-15T00:57:21.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1669 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ccce385f-64b3-476c-a3e9-0c3e2d24cbfb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
128472025-01-15T00:57:22.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
128482025-01-15T00:57:22.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
128492025-01-15T00:57:22.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
128502025-01-15T00:57:22.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
128512025-01-15T00:57:22.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128522025-01-15T00:57:22.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
128532025-01-15T00:57:22.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
128542025-01-15T00:57:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
128552025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
128562025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128572025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
128582025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
128592025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128602025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
128612025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
128622025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128632025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
128642025-01-15T00:57:22.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128652025-01-15T00:57:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
128662025-01-15T00:57:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128672025-01-15T00:57:22.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128682025-01-15T00:57:22.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128692025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
128702025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
128712025-01-15T00:57:22.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
128722025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
128732025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128742025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128752025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
128762025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128772025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
128782025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
128792025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
128802025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128812025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
128822025-01-15T00:57:22.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128832025-01-15T00:57:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128842025-01-15T00:57:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128852025-01-15T00:57:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128862025-01-15T00:57:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
128872025-01-15T00:57:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128882025-01-15T00:57:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
128892025-01-15T00:57:22.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1662, tv_nsec: 938312648 } })
128902025-01-15T00:57:22.608ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
128912025-01-15T00:57:22.608ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1662, tv_nsec: 938797468 } })
128922025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.300441ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
128932025-01-15T00:57:22.609ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
128942025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128952025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
128962025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
128972025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
128982025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
128992025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
129002025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
129012025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
129022025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
129032025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129042025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129052025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129062025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
129072025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
129082025-01-15T00:57:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
129092025-01-15T00:57:22.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129102025-01-15T00:57:22.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129112025-01-15T00:57:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
129122025-01-15T00:57:22.613ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
129132025-01-15T00:57:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
129142025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
129152025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129162025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129172025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129182025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129192025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
129202025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129212025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129222025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
129232025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
129242025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129252025-01-15T00:57:22.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
129262025-01-15T00:57:22.616ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129272025-01-15T00:57:22.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129282025-01-15T00:57:22.618ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129292025-01-15T00:57:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129302025-01-15T00:57:22.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129312025-01-15T00:57:22.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129322025-01-15T00:57:22.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129332025-01-15T00:57:22.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129342025-01-15T00:57:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129352025-01-15T00:57:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129362025-01-15T00:57:22.624ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1662, tv_nsec: 954787535 } })
129372025-01-15T00:57:22.625ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
129382025-01-15T00:57:22.647ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129392025-01-15T00:57:22.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
129402025-01-15T00:57:22.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
129412025-01-15T00:57:22.649ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129422025-01-15T00:57:22.649ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
129432025-01-15T00:57:22.649ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129442025-01-15T00:57:22.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
129452025-01-15T00:57:22.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129462025-01-15T00:57:22.652ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
129472025-01-15T00:57:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
129482025-01-15T00:57:22.653ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 44.298182ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
129492025-01-15T00:57:22.654ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
129502025-01-15T00:57:22.654ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129512025-01-15T00:57:22.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
129522025-01-15T00:57:22.655ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129532025-01-15T00:57:22.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129542025-01-15T00:57:22.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129552025-01-15T00:57:22.656ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129562025-01-15T00:57:22.656ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
129572025-01-15T00:57:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
129582025-01-15T00:57:22.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129592025-01-15T00:57:22.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129602025-01-15T00:57:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129612025-01-15T00:57:22.659ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129622025-01-15T00:57:22.659ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129632025-01-15T00:57:22.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129642025-01-15T00:57:22.661ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
129652025-01-15T00:57:22.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
129662025-01-15T00:57:22.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
129672025-01-15T00:57:22.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
129682025-01-15T00:57:22.662ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
129692025-01-15T00:57:22.663ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
129702025-01-15T00:57:22.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
129712025-01-15T00:57:22.663ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129722025-01-15T00:57:22.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.329874ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129732025-01-15T00:57:22.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129742025-01-15T00:57:22.664ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 54.894226ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
129752025-01-15T00:57:22.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129762025-01-15T00:57:22.670ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
129772025-01-15T00:57:22.670ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129782025-01-15T00:57:22.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129792025-01-15T00:57:22.672ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 67.381167ms iteration = 26 status = 0
129802025-01-15T00:57:22.680ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
129812025-01-15T00:57:22.680ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.204614ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
129822025-01-15T00:57:22.681ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
129832025-01-15T00:57:22.681ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129842025-01-15T00:57:22.681ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a40fda69-b348-4851-9f41-51a6f322e31b", "content-length": "26", "date": "Wed, 15 Jan 2025 00:57:21 GMT"} })
129852025-01-15T00:57:22.681ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129862025-01-15T00:57:22.681ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
129872025-01-15T00:57:22.681ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129882025-01-15T00:57:22.682ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d11230ea-df3f-486a-8ae3-80a1ff6b8f24", "content-length": "26", "date": "Wed, 15 Jan 2025 00:57:21 GMT"} })
129892025-01-15T00:57:22.682ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129902025-01-15T00:57:22.684ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129912025-01-15T00:57:22.684ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129922025-01-15T00:57:22.694ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129932025-01-15T00:57:22.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
129942025-01-15T00:57:22.696ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
129952025-01-15T00:57:22.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
129962025-01-15T00:57:22.697ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
129972025-01-15T00:57:22.697ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.906441ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
129982025-01-15T00:57:22.701ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129992025-01-15T00:57:22.701ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
130002025-01-15T00:57:22.701ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
130012025-01-15T00:57:22.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
130022025-01-15T00:57:22.704ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130032025-01-15T00:57:22.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130042025-01-15T00:57:22.704ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 95.425396ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
130052025-01-15T00:57:22.705ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.837783ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
130062025-01-15T00:57:22.705ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
130072025-01-15T00:57:22.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
130082025-01-15T00:57:22.711ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130092025-01-15T00:57:22.711ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
130102025-01-15T00:57:22.711ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
130112025-01-15T00:57:22.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130122025-01-15T00:57:22.712ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca1eeb55-e288-4415-8cd1-02bd3dd7759c", "content-length": "26", "date": "Wed, 15 Jan 2025 00:57:21 GMT"} })
130132025-01-15T00:57:22.712ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
130142025-01-15T00:57:22.713ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130152025-01-15T00:57:22.714ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
130162025-01-15T00:57:22.715ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130172025-01-15T00:57:22.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130182025-01-15T00:57:22.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130192025-01-15T00:57:22.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130202025-01-15T00:57:22.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
130212025-01-15T00:57:22.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130222025-01-15T00:57:22.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130232025-01-15T00:57:22.735ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
130242025-01-15T00:57:22.735ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 130.234067ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
130252025-01-15T00:57:22.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 135.201352ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
130262025-01-15T00:57:22.745ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
130272025-01-15T00:57:22.745ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
130282025-01-15T00:57:22.745ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 137.875173ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
130292025-01-15T00:57:22.759ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 154.570795ms iteration = 29 status = {"physical_disks_added":0}
130302025-01-15T00:57:22.776ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
130312025-01-15T00:57:22.776ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c699f725-a433-4fa6-8fb2-411b7dc45150", "content-length": "2", "date": "Wed, 15 Jan 2025 00:57:22 GMT"} })
130322025-01-15T00:57:22.778ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130332025-01-15T00:57:22.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130342025-01-15T00:57:22.780ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 178.141458ms iteration = 26 status = null
130352025-01-15T00:57:22.860ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
130362025-01-15T00:57:22.860ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 257.263601ms iteration = 26 status = {}
130372025-01-15T00:57:22.860ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130382025-01-15T00:57:22.860ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ada7fe79-5613-4091-bb02-88f48fedc92b", "content-length": "372", "date": "Wed, 15 Jan 2025 00:57:21 GMT"} })
130392025-01-15T00:57:22.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130402025-01-15T00:57:22.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130412025-01-15T00:57:22.874ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
130422025-01-15T00:57:22.874ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
130432025-01-15T00:57:22.874ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bfdb69b5-52cb-46a5-93c9-2071e12d8651", "date": "Wed, 15 Jan 2025 00:57:21 GMT"} })
130442025-01-15T00:57:22.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130452025-01-15T00:57:22.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130462025-01-15T00:57:22.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130472025-01-15T00:57:22.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130482025-01-15T00:57:22.877ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
130492025-01-15T00:57:22.878ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d3f9be1-b587-4d40-9def-169e96995b40", "content-length": "691", "date": "Wed, 15 Jan 2025 00:57:21 GMT"} })
130502025-01-15T00:57:22.878ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
130512025-01-15T00:57:22.878ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
130522025-01-15T00:57:22.878ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
130532025-01-15T00:57:22.879ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 271.527526ms iteration = 27 status = {}
130542025-01-15T00:57:22.879ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130552025-01-15T00:57:22.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130562025-01-15T00:57:22.883ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
130572025-01-15T00:57:22.883ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130582025-01-15T00:57:22.883ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3b52b44a-20b6-40ae-8957-0a57adababe4", "date": "Wed, 15 Jan 2025 00:57:21 GMT"} })
130592025-01-15T00:57:22.885ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.789767ms iteration = 27 status = {}
130602025-01-15T00:57:22.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130612025-01-15T00:57:22.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130622025-01-15T00:57:22.922ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
130632025-01-15T00:57:22.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130642025-01-15T00:57:22.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130652025-01-15T00:57:22.932ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
130662025-01-15T00:57:22.932ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1def299-87e9-4ca0-bf88-689d751edb7d", "content-length": "134", "date": "Wed, 15 Jan 2025 00:57:22 GMT"} })
130672025-01-15T00:57:22.932ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
130682025-01-15T00:57:22.932ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
130692025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
130702025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
130712025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130722025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130732025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130742025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
130752025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
130762025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
130772025-01-15T00:57:22.933ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
130782025-01-15T00:57:22.933ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130792025-01-15T00:57:22.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130802025-01-15T00:57:22.935ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
130812025-01-15T00:57:22.935ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2f17fef-a81e-4d86-8bae-0786194f7c22", "content-length": "2", "date": "Wed, 15 Jan 2025 00:57:22 GMT"} })
130822025-01-15T00:57:22.935ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
130832025-01-15T00:57:22.935ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "171fe436-b4d4-4406-97e2-cec77bb19134", "content-length": "51", "date": "Wed, 15 Jan 2025 00:57:22 GMT"} })
130842025-01-15T00:57:22.935ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
130852025-01-15T00:57:22.935ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
130862025-01-15T00:57:23.026ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2dab4751-30c4-45de-9960-3622464fbde2", "date": "Wed, 15 Jan 2025 00:57:23 GMT"} })
130872025-01-15T00:57:23.026ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
130882025-01-15T00:57:23.026ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
130892025-01-15T00:57:23.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ae389976-f2a0-4ee3-ab7a-2c59feb4a604 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
130902025-01-15T00:57:23.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ae389976-f2a0-4ee3-ab7a-2c59feb4a604 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
130912025-01-15T00:57:23.026ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b5d493c-cc88-40a8-8d5a-e5ffd0bcc0be", "content-length": "682", "date": "Wed, 15 Jan 2025 00:57:22 GMT"} })
130922025-01-15T00:57:23.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130932025-01-15T00:57:23.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130942025-01-15T00:57:23.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ae389976-f2a0-4ee3-ab7a-2c59feb4a604 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
130952025-01-15T00:57:23.035ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130962025-01-15T00:57:23.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130972025-01-15T00:57:23.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130982025-01-15T00:57:23.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130992025-01-15T00:57:23.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131002025-01-15T00:57:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131012025-01-15T00:57:23.048ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 444.125397ms iteration = 26 status = {}
131022025-01-15T00:57:24.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a6237953-d159-4c97-b2a5-de3cf11457ef roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131032025-01-15T00:57:24.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a6237953-d159-4c97-b2a5-de3cf11457ef resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131042025-01-15T00:57:24.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2280 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a6237953-d159-4c97-b2a5-de3cf11457ef response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131052025-01-15T00:57:24.292ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 780 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = b488e6b9-5e41-4101-913e-3843cf6f296e response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
131062025-01-15T00:57:25.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = da123103-9b7a-45cd-b839-701e391a8a21 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131072025-01-15T00:57:25.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = da123103-9b7a-45cd-b839-701e391a8a21 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131082025-01-15T00:57:25.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = da123103-9b7a-45cd-b839-701e391a8a21 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131092025-01-15T00:57:26.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6bb1270c-f609-4fb5-9697-39da29e46804 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131102025-01-15T00:57:26.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6bb1270c-f609-4fb5-9697-39da29e46804 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131112025-01-15T00:57:26.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6bb1270c-f609-4fb5-9697-39da29e46804 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131122025-01-15T00:57:27.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5fcb09e7-a7b9-4b5a-bbf5-202b127555a9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131132025-01-15T00:57:27.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5fcb09e7-a7b9-4b5a-bbf5-202b127555a9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131142025-01-15T00:57:27.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 5fcb09e7-a7b9-4b5a-bbf5-202b127555a9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131152025-01-15T00:57:28.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1a290286-c092-493f-8bb3-b981671749c9 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131162025-01-15T00:57:28.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1a290286-c092-493f-8bb3-b981671749c9 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131172025-01-15T00:57:28.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1798 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1a290286-c092-493f-8bb3-b981671749c9 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131182025-01-15T00:57:29.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 002c31db-e15b-468a-822f-e52bec3ff4f1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131192025-01-15T00:57:29.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 002c31db-e15b-468a-822f-e52bec3ff4f1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131202025-01-15T00:57:29.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2435 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 002c31db-e15b-468a-822f-e52bec3ff4f1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131212025-01-15T00:57:30.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6be3ae85-bfa3-4a02-bd1d-cc9f682123bc roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131222025-01-15T00:57:30.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6be3ae85-bfa3-4a02-bd1d-cc9f682123bc resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131232025-01-15T00:57:30.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2618 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6be3ae85-bfa3-4a02-bd1d-cc9f682123bc response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131242025-01-15T00:57:31.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d441242d-f231-4f11-98b1-b594d379a8be roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131252025-01-15T00:57:31.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d441242d-f231-4f11-98b1-b594d379a8be resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131262025-01-15T00:57:31.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2538 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d441242d-f231-4f11-98b1-b594d379a8be response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131272025-01-15T00:57:32.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1b4bcff5-0e46-4ed0-bb46-1bfdfba2072c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131282025-01-15T00:57:32.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1b4bcff5-0e46-4ed0-bb46-1bfdfba2072c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131292025-01-15T00:57:32.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1b4bcff5-0e46-4ed0-bb46-1bfdfba2072c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131302025-01-15T00:57:32.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
131312025-01-15T00:57:32.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131322025-01-15T00:57:32.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131332025-01-15T00:57:32.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131342025-01-15T00:57:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131352025-01-15T00:57:32.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131362025-01-15T00:57:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131372025-01-15T00:57:32.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
131382025-01-15T00:57:32.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131392025-01-15T00:57:32.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131402025-01-15T00:57:32.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131412025-01-15T00:57:32.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131422025-01-15T00:57:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131432025-01-15T00:57:32.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131442025-01-15T00:57:32.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131452025-01-15T00:57:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
131462025-01-15T00:57:32.614ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131472025-01-15T00:57:32.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131482025-01-15T00:57:32.623ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
131492025-01-15T00:57:32.623ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.29838ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
131502025-01-15T00:57:32.638ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.991616ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131512025-01-15T00:57:33.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 5ac64cda-5d47-480b-9a23-38979f915da2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
131522025-01-15T00:57:33.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 5ac64cda-5d47-480b-9a23-38979f915da2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
131532025-01-15T00:57:33.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3593 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = 5ac64cda-5d47-480b-9a23-38979f915da2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
131542025-01-15T00:57:33.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6bfd0d35-0858-4cb9-bc75-0df508abf996 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131552025-01-15T00:57:33.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6bfd0d35-0858-4cb9-bc75-0df508abf996 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131562025-01-15T00:57:33.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1993 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6bfd0d35-0858-4cb9-bc75-0df508abf996 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131572025-01-15T00:57:34.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 345bd985-0629-4064-9998-1316386a87f1 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131582025-01-15T00:57:34.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 345bd985-0629-4064-9998-1316386a87f1 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131592025-01-15T00:57:34.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 345bd985-0629-4064-9998-1316386a87f1 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131602025-01-15T00:57:34.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 2aede171-d828-4118-9827-b58d5570f17b roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
131612025-01-15T00:57:34.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 2aede171-d828-4118-9827-b58d5570f17b resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
131622025-01-15T00:57:34.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 772 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = acb53191-a79a-4d1f-8158-e2918e40c2d8 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
131632025-01-15T00:57:34.323ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40187 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = 2aede171-d828-4118-9827-b58d5570f17b response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?sort_by=id_ascending
131642025-01-15T00:57:34.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = dd457880-2aff-4615-9e2d-3086275e25a6 roles = RoleSet { roles: {} } uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
131652025-01-15T00:57:34.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = dd457880-2aff-4615-9e2d-3086275e25a6 resource = Database result = Ok(()) uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
131662025-01-15T00:57:34.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57675 req_id = dd457880-2aff-4615-9e2d-3086275e25a6 response_code = 200 uri = /metrics/collectors/dee7453b-558a-4d94-b6a0-8b27cb27f002/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmODA4MGU1YS1mYzNhLTQ2ZmEtYjVhMi1kNThlMWFlMjQxYWMifX0%3D
131672025-01-15T00:57:35.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ce2740ce-728e-4746-a30e-6ae80435f113 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131682025-01-15T00:57:35.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ce2740ce-728e-4746-a30e-6ae80435f113 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131692025-01-15T00:57:35.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ce2740ce-728e-4746-a30e-6ae80435f113 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131702025-01-15T00:57:36.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c5645330-df4a-4cec-8a02-73dcb88db3ce roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131712025-01-15T00:57:36.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c5645330-df4a-4cec-8a02-73dcb88db3ce resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131722025-01-15T00:57:36.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2599 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c5645330-df4a-4cec-8a02-73dcb88db3ce response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131732025-01-15T00:57:37.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca66aef2-848b-420c-89be-c3a8df0bcaf8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131742025-01-15T00:57:37.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca66aef2-848b-420c-89be-c3a8df0bcaf8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131752025-01-15T00:57:37.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca66aef2-848b-420c-89be-c3a8df0bcaf8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131762025-01-15T00:57:38.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80a4a750-8164-42aa-96c7-c35f746477cd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131772025-01-15T00:57:38.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80a4a750-8164-42aa-96c7-c35f746477cd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131782025-01-15T00:57:38.352ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2620 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 80a4a750-8164-42aa-96c7-c35f746477cd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131792025-01-15T00:57:39.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab26c32f-d5f4-4c67-b797-886c519765a8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131802025-01-15T00:57:39.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab26c32f-d5f4-4c67-b797-886c519765a8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131812025-01-15T00:57:39.374ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2246 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ab26c32f-d5f4-4c67-b797-886c519765a8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131822025-01-15T00:57:40.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70286f68-b641-4ad1-9b35-7798ef1aea30 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131832025-01-15T00:57:40.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70286f68-b641-4ad1-9b35-7798ef1aea30 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131842025-01-15T00:57:40.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 70286f68-b641-4ad1-9b35-7798ef1aea30 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131852025-01-15T00:57:41.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 12515b05-8085-4a82-b1b9-cb626c9ee35e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131862025-01-15T00:57:41.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 12515b05-8085-4a82-b1b9-cb626c9ee35e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131872025-01-15T00:57:41.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 12515b05-8085-4a82-b1b9-cb626c9ee35e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131882025-01-15T00:57:42.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6caf69d9-d359-40eb-8841-2a01823dd6b3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131892025-01-15T00:57:42.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6caf69d9-d359-40eb-8841-2a01823dd6b3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131902025-01-15T00:57:42.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6caf69d9-d359-40eb-8841-2a01823dd6b3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
131912025-01-15T00:57:42.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
131922025-01-15T00:57:42.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131932025-01-15T00:57:42.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131942025-01-15T00:57:42.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131952025-01-15T00:57:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131962025-01-15T00:57:42.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131972025-01-15T00:57:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131982025-01-15T00:57:42.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
131992025-01-15T00:57:42.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132002025-01-15T00:57:42.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132012025-01-15T00:57:42.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132022025-01-15T00:57:42.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132032025-01-15T00:57:42.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132042025-01-15T00:57:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
132052025-01-15T00:57:42.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132062025-01-15T00:57:42.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132072025-01-15T00:57:42.625ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
132082025-01-15T00:57:42.625ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.723898ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
132092025-01-15T00:57:42.637ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132102025-01-15T00:57:42.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132112025-01-15T00:57:42.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.67609ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132122025-01-15T00:57:43.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ba5bb64-000e-430c-aa2c-6d5f56266073 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132132025-01-15T00:57:43.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ba5bb64-000e-430c-aa2c-6d5f56266073 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132142025-01-15T00:57:43.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3ba5bb64-000e-430c-aa2c-6d5f56266073 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132152025-01-15T00:57:44.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 573 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 4848d50b-7c0f-4654-8627-7bf0820a9edb response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
132162025-01-15T00:57:44.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a960c517-6085-4c66-a717-4308376a2f2d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132172025-01-15T00:57:44.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a960c517-6085-4c66-a717-4308376a2f2d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132182025-01-15T00:57:44.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2610 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a960c517-6085-4c66-a717-4308376a2f2d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132192025-01-15T00:57:45.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e6cafd6-978d-449e-b49c-4793b037e87f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132202025-01-15T00:57:45.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e6cafd6-978d-449e-b49c-4793b037e87f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132212025-01-15T00:57:45.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e6cafd6-978d-449e-b49c-4793b037e87f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132222025-01-15T00:57:46.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1caa0bf4-f456-4cf0-8cd6-680981d41592 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132232025-01-15T00:57:46.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1caa0bf4-f456-4cf0-8cd6-680981d41592 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132242025-01-15T00:57:46.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 1caa0bf4-f456-4cf0-8cd6-680981d41592 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132252025-01-15T00:57:47.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32f21844-a511-48d3-9275-15df8d7e8cdb roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132262025-01-15T00:57:47.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32f21844-a511-48d3-9275-15df8d7e8cdb resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132272025-01-15T00:57:47.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2343 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 32f21844-a511-48d3-9275-15df8d7e8cdb response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132282025-01-15T00:57:48.571ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e12fa10d-0e2c-4b0a-b34d-3923dd3707b8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132292025-01-15T00:57:48.571ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e12fa10d-0e2c-4b0a-b34d-3923dd3707b8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132302025-01-15T00:57:48.573ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2326 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e12fa10d-0e2c-4b0a-b34d-3923dd3707b8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132312025-01-15T00:57:49.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6d07a711-5a1b-456f-ae99-99a8557fdb05 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132322025-01-15T00:57:49.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6d07a711-5a1b-456f-ae99-99a8557fdb05 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132332025-01-15T00:57:49.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6d07a711-5a1b-456f-ae99-99a8557fdb05 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132342025-01-15T00:57:50.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea4084d7-e89e-4bbb-bce0-69539c5c4b72 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132352025-01-15T00:57:50.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea4084d7-e89e-4bbb-bce0-69539c5c4b72 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132362025-01-15T00:57:50.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ea4084d7-e89e-4bbb-bce0-69539c5c4b72 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132372025-01-15T00:57:51.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0364e727-8f41-4a71-8137-282d9cf51030 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132382025-01-15T00:57:51.635ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0364e727-8f41-4a71-8137-282d9cf51030 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132392025-01-15T00:57:51.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2508 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0364e727-8f41-4a71-8137-282d9cf51030 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
132402025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
132412025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
132422025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
132432025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
132442025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
132452025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
132462025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
132472025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
132482025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
132492025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
132502025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
132512025-01-15T00:57:52.602ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee
132522025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.54\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee"}
132532025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
132542025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
132552025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
132562025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
132572025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
132582025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
132592025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
132602025-01-15T00:57:52.602ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
132612025-01-15T00:57:52.603ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-01-15 00:47:52.602932717 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
132622025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
132632025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
132642025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132652025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132662025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
132672025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
132682025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
132692025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
132702025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
132712025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132722025-01-15T00:57:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("428f96bb-3527-41ae-b455-13a78e2ab5fa.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b51ac62e-be31-47f6-aa1e-af03a1941a9c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1692, tv_nsec: 933426434 } })
132732025-01-15T00:57:52.603ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40ae34f1-1e3b-45ab-8bbd-332390cbbebd.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("794b81d3-84d4-414f-8833-aa968fe812f9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("ca7cda21-9b20-4e26-b219-943f968e7f55.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1692, tv_nsec: 933430844 } })
132742025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
132752025-01-15T00:57:52.603ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.060711ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
132762025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
132772025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
132782025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.189283ms iteration = 14 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
132792025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
132802025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
132812025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
132822025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132832025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132842025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
132852025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
132862025-01-15T00:57:52.604ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
132872025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
132882025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
132892025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
132902025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132912025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132922025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
132932025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
132942025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132952025-01-15T00:57:52.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132962025-01-15T00:57:52.606ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1692, tv_nsec: 936099836 } })
132972025-01-15T00:57:52.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.324014ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
132982025-01-15T00:57:52.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
132992025-01-15T00:57:52.606ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
133002025-01-15T00:57:52.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
133012025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133022025-01-15T00:57:52.607ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1692, tv_nsec: 937155136 } })
133032025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
133042025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133052025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
133062025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
133072025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
133082025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133092025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
133102025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
133112025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133122025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
133132025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
133142025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
133152025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133162025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
133172025-01-15T00:57:52.607ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
133182025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133192025-01-15T00:57:52.607ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
133202025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
133212025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133222025-01-15T00:57:52.607ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-01-15 00:47:52.602932717 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
133232025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133242025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.733051ms iteration = 14 status = {"expiration":"2025-01-15T00:47:52.602932717Z","pruned":[]}
133252025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133262025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133272025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133282025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
133292025-01-15T00:57:52.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
133302025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
133312025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
133322025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
133332025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
133342025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
133352025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
133362025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
133372025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
133382025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
133392025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
133402025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
133412025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
133422025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133432025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
133442025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
133452025-01-15T00:57:52.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
133462025-01-15T00:57:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
133472025-01-15T00:57:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133482025-01-15T00:57:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
133492025-01-15T00:57:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
133502025-01-15T00:57:52.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
133512025-01-15T00:57:52.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133522025-01-15T00:57:52.611ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133532025-01-15T00:57:52.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
133542025-01-15T00:57:52.611ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133552025-01-15T00:57:52.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133562025-01-15T00:57:52.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133572025-01-15T00:57:52.613ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133582025-01-15T00:57:52.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
133592025-01-15T00:57:52.613ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
133602025-01-15T00:57:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
133612025-01-15T00:57:52.614ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
133622025-01-15T00:57:52.614ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133632025-01-15T00:57:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133642025-01-15T00:57:52.615ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
133652025-01-15T00:57:52.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133662025-01-15T00:57:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133672025-01-15T00:57:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133682025-01-15T00:57:52.616ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133692025-01-15T00:57:52.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133702025-01-15T00:57:52.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133712025-01-15T00:57:52.619ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
133722025-01-15T00:57:52.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133732025-01-15T00:57:52.621ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133742025-01-15T00:57:52.623ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133752025-01-15T00:57:52.623ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133762025-01-15T00:57:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133772025-01-15T00:57:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
133782025-01-15T00:57:52.623ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
133792025-01-15T00:57:52.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
133802025-01-15T00:57:52.625ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
133812025-01-15T00:57:52.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
133822025-01-15T00:57:52.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133832025-01-15T00:57:52.627ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.913925ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
133842025-01-15T00:57:52.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133852025-01-15T00:57:52.628ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
133862025-01-15T00:57:52.628ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
133872025-01-15T00:57:52.628ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.347373ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
133882025-01-15T00:57:52.629ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133892025-01-15T00:57:52.629ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133902025-01-15T00:57:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133912025-01-15T00:57:52.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133922025-01-15T00:57:52.630ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133932025-01-15T00:57:52.630ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1692, tv_nsec: 960478905 } })
133942025-01-15T00:57:52.630ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133952025-01-15T00:57:52.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133962025-01-15T00:57:52.630ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
133972025-01-15T00:57:52.631ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133982025-01-15T00:57:52.633ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133992025-01-15T00:57:52.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134002025-01-15T00:57:52.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134012025-01-15T00:57:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
134022025-01-15T00:57:52.636ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134032025-01-15T00:57:52.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134042025-01-15T00:57:52.644ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134052025-01-15T00:57:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
134062025-01-15T00:57:52.646ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
134072025-01-15T00:57:52.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
134082025-01-15T00:57:52.647ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134092025-01-15T00:57:52.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
134102025-01-15T00:57:52.649ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
134112025-01-15T00:57:52.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
134122025-01-15T00:57:52.651ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134132025-01-15T00:57:52.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134142025-01-15T00:57:52.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134152025-01-15T00:57:52.654ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
134162025-01-15T00:57:52.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 078c40aa-f9e9-43d5-aa69-eea16e86f234 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
134172025-01-15T00:57:52.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 078c40aa-f9e9-43d5-aa69-eea16e86f234 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
134182025-01-15T00:57:52.655ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134192025-01-15T00:57:52.657ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
134202025-01-15T00:57:52.657ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
134212025-01-15T00:57:52.657ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
134222025-01-15T00:57:52.657ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
134232025-01-15T00:57:52.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
134242025-01-15T00:57:52.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
134252025-01-15T00:57:52.658ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134262025-01-15T00:57:52.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134272025-01-15T00:57:52.659ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
134282025-01-15T00:57:52.659ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
134292025-01-15T00:57:52.659ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
134302025-01-15T00:57:52.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
134312025-01-15T00:57:52.660ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134322025-01-15T00:57:52.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5150 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 078c40aa-f9e9-43d5-aa69-eea16e86f234 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
134332025-01-15T00:57:52.661ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134342025-01-15T00:57:52.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134352025-01-15T00:57:52.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134362025-01-15T00:57:52.662ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
134372025-01-15T00:57:52.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
134382025-01-15T00:57:52.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
134392025-01-15T00:57:52.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
134402025-01-15T00:57:52.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
134412025-01-15T00:57:52.667ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
134422025-01-15T00:57:52.667ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
134432025-01-15T00:57:52.667ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134442025-01-15T00:57:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
134452025-01-15T00:57:52.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134462025-01-15T00:57:52.668ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
134472025-01-15T00:57:52.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
134482025-01-15T00:57:52.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.011983ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
134492025-01-15T00:57:52.672ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.192086ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
134502025-01-15T00:57:52.673ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
134512025-01-15T00:57:52.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
134522025-01-15T00:57:52.673ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134532025-01-15T00:57:52.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134542025-01-15T00:57:52.683ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134552025-01-15T00:57:52.684ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 74.885351ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
134562025-01-15T00:57:52.684ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
134572025-01-15T00:57:52.684ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
134582025-01-15T00:57:52.684ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.231764ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
134592025-01-15T00:57:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
134602025-01-15T00:57:52.687ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
134612025-01-15T00:57:52.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
134622025-01-15T00:57:52.689ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
134632025-01-15T00:57:52.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
134642025-01-15T00:57:52.691ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
134652025-01-15T00:57:52.691ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.759332ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
134662025-01-15T00:57:52.692ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.606906ms iteration = 27 status = 0
134672025-01-15T00:57:52.693ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134682025-01-15T00:57:52.696ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
134692025-01-15T00:57:52.696ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134702025-01-15T00:57:52.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134712025-01-15T00:57:52.702ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134722025-01-15T00:57:52.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134732025-01-15T00:57:52.704ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
134742025-01-15T00:57:52.704ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
134752025-01-15T00:57:52.704ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
134762025-01-15T00:57:52.704ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
134772025-01-15T00:57:52.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134782025-01-15T00:57:52.705ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134792025-01-15T00:57:52.706ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134802025-01-15T00:57:52.707ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
134812025-01-15T00:57:52.708ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
134822025-01-15T00:57:52.708ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 100.79753ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
134832025-01-15T00:57:52.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
134842025-01-15T00:57:52.709ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
134852025-01-15T00:57:52.709ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
134862025-01-15T00:57:52.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134872025-01-15T00:57:52.709ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
134882025-01-15T00:57:52.709ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 106.99961ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
134892025-01-15T00:57:52.711ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
134902025-01-15T00:57:52.711ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 0 version = 2
134912025-01-15T00:57:52.711ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
134922025-01-15T00:57:52.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
134932025-01-15T00:57:52.711ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 107.132612ms iteration = 30 status = {"physical_disks_added":0}
134942025-01-15T00:57:52.713ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134952025-01-15T00:57:52.715ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
134962025-01-15T00:57:52.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
134972025-01-15T00:57:52.715ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
134982025-01-15T00:57:52.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
134992025-01-15T00:57:52.716ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
135002025-01-15T00:57:52.716ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135012025-01-15T00:57:52.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
135022025-01-15T00:57:52.716ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.591059ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
135032025-01-15T00:57:52.717ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135042025-01-15T00:57:52.717ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135052025-01-15T00:57:52.717ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
135062025-01-15T00:57:52.717ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135072025-01-15T00:57:52.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135082025-01-15T00:57:52.718ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = f6371306-73d3-4cf2-9f48-64dc54e89007 dns_zone_name = oxide.test found_so_far = 1 version = 2
135092025-01-15T00:57:52.718ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
135102025-01-15T00:57:52.718ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-01-15 00:45:38.626083 UTC dns_group = external generation = 2
135112025-01-15T00:57:52.718ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 115.643275ms iteration = 14 status = {"generation":2}
135122025-01-15T00:57:52.720ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
135132025-01-15T00:57:52.720ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
135142025-01-15T00:57:52.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
135152025-01-15T00:57:52.723ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
135162025-01-15T00:57:52.723ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
135172025-01-15T00:57:52.723ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135182025-01-15T00:57:52.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
135192025-01-15T00:57:52.725ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135202025-01-15T00:57:52.728ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
135212025-01-15T00:57:52.728ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135222025-01-15T00:57:52.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
135232025-01-15T00:57:52.730ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 13865f23-580e-4fa1-b3cc-5bd6d1b7bfaa dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
135242025-01-15T00:57:52.730ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
135252025-01-15T00:57:52.730ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-01-15 00:45:37.260103 UTC dns_group = internal generation = 1
135262025-01-15T00:57:52.731ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 128.105726ms iteration = 14 status = {"generation":1}
135272025-01-15T00:57:52.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 134.742163ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
135282025-01-15T00:57:52.745ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-01-15T00:44:45.651085Z, time_modified: 2025-01-15T00:44:45.651085Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, db_silo: Silo { identity: SiloIdentity { id: 5cb90e2d-bd32-442c-b5f9-1259cc451f17, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-01-15T00:45:38.453553Z, time_modified: 2025-01-15T00:45:38.453553Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9" }] }) }
135292025-01-15T00:57:52.745ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 142.987882ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]}},"default_endpoint":{"silo_id":"5cb90e2d-bd32-442c-b5f9-1259cc451f17","tls_certs":["c8a466377e9524c1320fb15ff51d8404766f61d8bdf85162f8ed1c225bab90d9"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
135302025-01-15T00:57:52.751ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
135312025-01-15T00:57:52.751ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 146.934868ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
135322025-01-15T00:57:52.756ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
135332025-01-15T00:57:52.756ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
135342025-01-15T00:57:52.756ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.444166ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
135352025-01-15T00:57:52.764ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
135362025-01-15T00:57:52.764ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 156.710196ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
135372025-01-15T00:57:52.781ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
135382025-01-15T00:57:52.788ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
135392025-01-15T00:57:52.794ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
135402025-01-15T00:57:52.794ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135412025-01-15T00:57:52.794ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c41af0e-89de-41ad-abbd-bd246fef5d01", "content-length": "26", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
135422025-01-15T00:57:52.794ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135432025-01-15T00:57:52.795ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
135442025-01-15T00:57:52.820ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
135452025-01-15T00:57:52.820ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
135462025-01-15T00:57:52.820ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5ba6445-ec69-4dd1-ad32-e6e38d661df7", "content-length": "372", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
135472025-01-15T00:57:52.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135482025-01-15T00:57:52.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135492025-01-15T00:57:52.862ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
135502025-01-15T00:57:52.862ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
135512025-01-15T00:57:52.862ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "52582b34-9887-431e-a81d-76b13900b15a", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
135522025-01-15T00:57:52.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135532025-01-15T00:57:52.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135542025-01-15T00:57:52.864ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135552025-01-15T00:57:52.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135562025-01-15T00:57:52.881ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
135572025-01-15T00:57:52.881ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135582025-01-15T00:57:52.882ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "be5c4db1-fcbc-4687-9c03-3a9ff0397c8d", "content-length": "26", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
135592025-01-15T00:57:52.882ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135602025-01-15T00:57:52.883ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
135612025-01-15T00:57:52.902ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
135622025-01-15T00:57:52.902ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
135632025-01-15T00:57:52.903ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "037f0746-91d0-4f16-8758-9c0fc2c6924c", "content-length": "26", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
135642025-01-15T00:57:52.903ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
135652025-01-15T00:57:52.905ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
135662025-01-15T00:57:52.955ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
135672025-01-15T00:57:52.955ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d63f930-ec35-49b6-aa46-bf70295a79d7", "content-length": "691", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
135682025-01-15T00:57:52.955ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
135692025-01-15T00:57:52.955ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
135702025-01-15T00:57:52.955ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
135712025-01-15T00:57:52.957ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
135722025-01-15T00:57:52.957ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d8407bf1-71b9-48c7-8262-ecc8e22e072a", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
135732025-01-15T00:57:52.957ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
135742025-01-15T00:57:52.957ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135752025-01-15T00:57:52.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
135762025-01-15T00:57:52.958ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 351.22962ms iteration = 28 status = {}
135772025-01-15T00:57:52.960ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3c4d8589-3bcd-42de-aa84-d7aba1550bff", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
135782025-01-15T00:57:52.960ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
135792025-01-15T00:57:52.961ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
135802025-01-15T00:57:52.961ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
135812025-01-15T00:57:52.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "78132a6a-fe8e-4ed8-bf1c-46f74dd2edfd", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
135822025-01-15T00:57:52.963ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
135832025-01-15T00:57:52.963ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 360.427986ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
135842025-01-15T00:57:52.964ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 357.390118ms iteration = 28 status = {}
135852025-01-15T00:57:52.965ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
135862025-01-15T00:57:52.969ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 366.484353ms iteration = 27 status = {}
135872025-01-15T00:57:52.996ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
135882025-01-15T00:57:52.996ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "14c93b7c-1f5b-4444-8dff-8497eeef617b", "content-length": "2", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
135892025-01-15T00:57:52.997ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
135902025-01-15T00:57:52.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
135912025-01-15T00:57:52.999ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 396.672394ms iteration = 27 status = null
135922025-01-15T00:57:53.034ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
135932025-01-15T00:57:53.034ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "145cb1c8-cd38-479e-962a-3e40d74e7a58", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
135942025-01-15T00:57:53.034ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
135952025-01-15T00:57:53.036ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a95f0d5f-5cab-4577-a19d-36b36b3d6f65", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
135962025-01-15T00:57:53.036ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
135972025-01-15T00:57:53.037ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "90f7c88a-02b1-42f5-8ab2-438b6eb63d78", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
135982025-01-15T00:57:53.037ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
135992025-01-15T00:57:53.039ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
136002025-01-15T00:57:53.039ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.836077ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
136012025-01-15T00:57:53.081ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136022025-01-15T00:57:53.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136032025-01-15T00:57:53.083ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
136042025-01-15T00:57:53.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136052025-01-15T00:57:53.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136062025-01-15T00:57:53.093ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
136072025-01-15T00:57:53.094ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "13f24c16-42ad-4e60-b14f-10a6aaf918d4", "content-length": "134", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
136082025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
136092025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
136102025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
136112025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
136122025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136132025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136142025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136152025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
136162025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
136172025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
136182025-01-15T00:57:53.094ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
136192025-01-15T00:57:53.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136202025-01-15T00:57:53.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136212025-01-15T00:57:53.097ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
136222025-01-15T00:57:53.097ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fff4cfb2-832a-431c-a48c-cb5426a63265", "content-length": "2", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
136232025-01-15T00:57:53.097ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
136242025-01-15T00:57:53.097ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c67b486c-ea4c-488a-b30d-8eb17d5817f6", "content-length": "51", "date": "Wed, 15 Jan 2025 00:57:52 GMT"} })
136252025-01-15T00:57:53.097ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
136262025-01-15T00:57:53.097ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
136272025-01-15T00:57:53.192ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a945fb6c-303e-4bf6-8081-114f603a87f1", "date": "Wed, 15 Jan 2025 00:57:53 GMT"} })
136282025-01-15T00:57:53.192ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
136292025-01-15T00:57:53.192ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
136302025-01-15T00:57:53.192ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b62b160b-1c1e-47ae-83bc-0924b211059f", "content-length": "682", "date": "Wed, 15 Jan 2025 00:57:53 GMT"} })
136312025-01-15T00:57:53.192ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136322025-01-15T00:57:53.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136332025-01-15T00:57:53.196ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136342025-01-15T00:57:53.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136352025-01-15T00:57:53.199ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136362025-01-15T00:57:53.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136372025-01-15T00:57:53.202ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136382025-01-15T00:57:53.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136392025-01-15T00:57:53.210ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 605.544714ms iteration = 27 status = {}
136402025-01-15T00:57:53.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0194d5e0-2415-496e-85d6-e09e45ce615b roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136412025-01-15T00:57:53.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0194d5e0-2415-496e-85d6-e09e45ce615b resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136422025-01-15T00:57:53.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0194d5e0-2415-496e-85d6-e09e45ce615b response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136432025-01-15T00:57:54.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 583 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = d505430d-5d99-422d-82ee-290914092a35 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
136442025-01-15T00:57:54.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c027a671-d6eb-4f8d-9d1e-5975147d32dd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136452025-01-15T00:57:54.711ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c027a671-d6eb-4f8d-9d1e-5975147d32dd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136462025-01-15T00:57:54.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = c027a671-d6eb-4f8d-9d1e-5975147d32dd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136472025-01-15T00:57:55.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a884cf4c-14cb-4390-949a-152f39080b52 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136482025-01-15T00:57:55.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a884cf4c-14cb-4390-949a-152f39080b52 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136492025-01-15T00:57:55.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2693 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a884cf4c-14cb-4390-949a-152f39080b52 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136502025-01-15T00:57:56.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 015af15c-507f-4c15-8a6d-c6a12c3e7bf4 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136512025-01-15T00:57:56.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 015af15c-507f-4c15-8a6d-c6a12c3e7bf4 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136522025-01-15T00:57:56.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 015af15c-507f-4c15-8a6d-c6a12c3e7bf4 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136532025-01-15T00:57:57.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ddfca23-be9e-447f-bdde-92a2fc45dcf3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136542025-01-15T00:57:57.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ddfca23-be9e-447f-bdde-92a2fc45dcf3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136552025-01-15T00:57:57.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 0ddfca23-be9e-447f-bdde-92a2fc45dcf3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136562025-01-15T00:57:58.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 590e6b28-8486-423f-bf44-a51400ca7f72 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136572025-01-15T00:57:58.798ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 590e6b28-8486-423f-bf44-a51400ca7f72 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136582025-01-15T00:57:58.800ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2670 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 590e6b28-8486-423f-bf44-a51400ca7f72 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136592025-01-15T00:57:59.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60f9d27f-98d8-4294-a5cf-434b713e5936 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136602025-01-15T00:57:59.821ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60f9d27f-98d8-4294-a5cf-434b713e5936 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136612025-01-15T00:57:59.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1869 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 60f9d27f-98d8-4294-a5cf-434b713e5936 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136622025-01-15T00:58:00.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9ac3ac5c-c5a5-4a74-bda5-68333f2746fa roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136632025-01-15T00:58:00.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9ac3ac5c-c5a5-4a74-bda5-68333f2746fa resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136642025-01-15T00:58:00.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2214 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 9ac3ac5c-c5a5-4a74-bda5-68333f2746fa response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136652025-01-15T00:58:01.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6176a23a-453b-4500-85ff-50621ebc136e roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136662025-01-15T00:58:01.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6176a23a-453b-4500-85ff-50621ebc136e resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136672025-01-15T00:58:01.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6176a23a-453b-4500-85ff-50621ebc136e response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136682025-01-15T00:58:02.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
136692025-01-15T00:58:02.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136702025-01-15T00:58:02.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136712025-01-15T00:58:02.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136722025-01-15T00:58:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
136732025-01-15T00:58:02.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136742025-01-15T00:58:02.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136752025-01-15T00:58:02.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
136762025-01-15T00:58:02.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136772025-01-15T00:58:02.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136782025-01-15T00:58:02.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136792025-01-15T00:58:02.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136802025-01-15T00:58:02.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136812025-01-15T00:58:02.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136822025-01-15T00:58:02.639ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.913095ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
136832025-01-15T00:58:02.644ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136842025-01-15T00:58:02.646ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
136852025-01-15T00:58:02.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136862025-01-15T00:58:02.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136872025-01-15T00:58:02.656ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
136882025-01-15T00:58:02.656ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.057391ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
136892025-01-15T00:58:02.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b249067d-8647-4e9a-95e6-3778e958610c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136902025-01-15T00:58:02.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b249067d-8647-4e9a-95e6-3778e958610c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136912025-01-15T00:58:02.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2225 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b249067d-8647-4e9a-95e6-3778e958610c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136922025-01-15T00:58:03.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = fc3c7f2a-6da7-4503-8098-f93f54fd10ea roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
136932025-01-15T00:58:03.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = fc3c7f2a-6da7-4503-8098-f93f54fd10ea resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
136942025-01-15T00:58:03.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3740 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:43905 req_id = fc3c7f2a-6da7-4503-8098-f93f54fd10ea response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
136952025-01-15T00:58:03.905ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd0696bc-a03a-4157-8cc8-aa7c38686308 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136962025-01-15T00:58:03.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd0696bc-a03a-4157-8cc8-aa7c38686308 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136972025-01-15T00:58:03.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2168 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fd0696bc-a03a-4157-8cc8-aa7c38686308 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
136982025-01-15T00:58:04.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 566 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 5c8b39b8-8d69-4c92-99c5-d79af5d83d9a response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
136992025-01-15T00:58:04.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b6361744-3b28-4c32-a9ec-b424b6154cd2 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137002025-01-15T00:58:04.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b6361744-3b28-4c32-a9ec-b424b6154cd2 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137012025-01-15T00:58:04.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2504 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b6361744-3b28-4c32-a9ec-b424b6154cd2 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137022025-01-15T00:58:05.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e8d642a-e3a6-47c1-959f-a4cf7f3faa4a roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137032025-01-15T00:58:05.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e8d642a-e3a6-47c1-959f-a4cf7f3faa4a resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137042025-01-15T00:58:05.951ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2501 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8e8d642a-e3a6-47c1-959f-a4cf7f3faa4a response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137052025-01-15T00:58:06.971ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 029ec86c-a6f5-48e7-af7b-2aa68e4ea0b7 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137062025-01-15T00:58:06.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 029ec86c-a6f5-48e7-af7b-2aa68e4ea0b7 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137072025-01-15T00:58:06.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 029ec86c-a6f5-48e7-af7b-2aa68e4ea0b7 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137082025-01-15T00:58:07.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fbf0e050-1b66-45ed-a588-1337f886c183 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137092025-01-15T00:58:07.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fbf0e050-1b66-45ed-a588-1337f886c183 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137102025-01-15T00:58:07.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = fbf0e050-1b66-45ed-a588-1337f886c183 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137112025-01-15T00:58:09.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6656aaae-0988-4d65-af3c-c363dc234418 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137122025-01-15T00:58:09.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6656aaae-0988-4d65-af3c-c363dc234418 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137132025-01-15T00:58:09.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2419 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 6656aaae-0988-4d65-af3c-c363dc234418 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137142025-01-15T00:58:10.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 30cf031a-1d2f-4e57-9907-10128cfadb11 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137152025-01-15T00:58:10.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 30cf031a-1d2f-4e57-9907-10128cfadb11 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137162025-01-15T00:58:10.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2314 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 30cf031a-1d2f-4e57-9907-10128cfadb11 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137172025-01-15T00:58:11.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8dba2647-84b8-4711-aa8a-d644d8b937ad roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137182025-01-15T00:58:11.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8dba2647-84b8-4711-aa8a-d644d8b937ad resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137192025-01-15T00:58:11.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2650 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8dba2647-84b8-4711-aa8a-d644d8b937ad response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137202025-01-15T00:58:12.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b8f6c4c5-a334-422f-919a-c1cbc29a1931 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137212025-01-15T00:58:12.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b8f6c4c5-a334-422f-919a-c1cbc29a1931 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137222025-01-15T00:58:12.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1962 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b8f6c4c5-a334-422f-919a-c1cbc29a1931 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137232025-01-15T00:58:12.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
137242025-01-15T00:58:12.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137252025-01-15T00:58:12.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137262025-01-15T00:58:12.605ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137272025-01-15T00:58:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137282025-01-15T00:58:12.607ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137292025-01-15T00:58:12.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137302025-01-15T00:58:12.607ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
137312025-01-15T00:58:12.607ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137322025-01-15T00:58:12.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137332025-01-15T00:58:12.609ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137342025-01-15T00:58:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137352025-01-15T00:58:12.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137362025-01-15T00:58:12.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137372025-01-15T00:58:12.611ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.63351ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137382025-01-15T00:58:12.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137392025-01-15T00:58:12.649ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
137402025-01-15T00:58:12.649ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137412025-01-15T00:58:12.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137422025-01-15T00:58:12.661ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
137432025-01-15T00:58:12.661ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.916404ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
137442025-01-15T00:58:13.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41a7dc8c-99f2-4c05-897c-a0cef6d557ee roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137452025-01-15T00:58:13.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41a7dc8c-99f2-4c05-897c-a0cef6d557ee resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137462025-01-15T00:58:13.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 41a7dc8c-99f2-4c05-897c-a0cef6d557ee response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137472025-01-15T00:58:14.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8c99b39c-e607-4407-9224-471486d766c8 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137482025-01-15T00:58:14.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8c99b39c-e607-4407-9224-471486d766c8 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137492025-01-15T00:58:14.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2781 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8c99b39c-e607-4407-9224-471486d766c8 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137502025-01-15T00:58:14.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 548 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = 6828d758-de99-4b34-bf91-d47881d9b4f7 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
137512025-01-15T00:58:15.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7757ccb7-1e61-4090-ade3-0ca176a8b8bd roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137522025-01-15T00:58:15.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7757ccb7-1e61-4090-ade3-0ca176a8b8bd resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137532025-01-15T00:58:15.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 7757ccb7-1e61-4090-ade3-0ca176a8b8bd response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137542025-01-15T00:58:16.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d513681b-42a8-4cb7-984f-0ca2e44d0e81 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137552025-01-15T00:58:16.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d513681b-42a8-4cb7-984f-0ca2e44d0e81 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137562025-01-15T00:58:16.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2238 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = d513681b-42a8-4cb7-984f-0ca2e44d0e81 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137572025-01-15T00:58:17.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2361e683-0e53-40b2-80ad-426f57b8acef roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137582025-01-15T00:58:17.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2361e683-0e53-40b2-80ad-426f57b8acef resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137592025-01-15T00:58:17.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2361e683-0e53-40b2-80ad-426f57b8acef response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137602025-01-15T00:58:18.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85881052-8320-44e0-aad5-9feee867209c roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137612025-01-15T00:58:18.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85881052-8320-44e0-aad5-9feee867209c resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137622025-01-15T00:58:18.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2822 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 85881052-8320-44e0-aad5-9feee867209c response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137632025-01-15T00:58:19.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a8634d4-dfe0-4a77-b5db-149d82cb1a37 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137642025-01-15T00:58:19.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a8634d4-dfe0-4a77-b5db-149d82cb1a37 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137652025-01-15T00:58:19.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2317 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 3a8634d4-dfe0-4a77-b5db-149d82cb1a37 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137662025-01-15T00:58:20.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8cd455bf-dc25-4729-a64d-e6789e56196d roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137672025-01-15T00:58:20.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8cd455bf-dc25-4729-a64d-e6789e56196d resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137682025-01-15T00:58:20.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2624 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 8cd455bf-dc25-4729-a64d-e6789e56196d response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137692025-01-15T00:58:21.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca59cde9-b9b5-4c0e-935a-888c359a5c3f roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137702025-01-15T00:58:21.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca59cde9-b9b5-4c0e-935a-888c359a5c3f resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137712025-01-15T00:58:21.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = ca59cde9-b9b5-4c0e-935a-888c359a5c3f response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137722025-01-15T00:58:22.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2df81c4f-fd25-411f-83bb-3ed58032f1d3 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137732025-01-15T00:58:22.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2df81c4f-fd25-411f-83bb-3ed58032f1d3 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137742025-01-15T00:58:22.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = 2df81c4f-fd25-411f-83bb-3ed58032f1d3 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
137752025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
137762025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
137772025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
137782025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
137792025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137802025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
137812025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
137822025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
137832025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
137842025-01-15T00:58:22.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137852025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
137862025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
137872025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137882025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 28 reason = Timeout
137892025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137902025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
137912025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137922025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
137932025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137942025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137952025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137962025-01-15T00:58:22.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
137972025-01-15T00:58:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1722, tv_nsec: 935841151 } })
137982025-01-15T00:58:22.605ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1722, tv_nsec: 935941743 } })
137992025-01-15T00:58:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1104
138002025-01-15T00:58:22.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138012025-01-15T00:58:22.606ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1104
138022025-01-15T00:58:22.606ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.286804ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
138032025-01-15T00:58:22.607ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138042025-01-15T00:58:22.607ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138052025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
138062025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
138072025-01-15T00:58:22.608ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
138082025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
138092025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
138102025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138112025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138122025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
138132025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
138142025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138152025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
138162025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
138172025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
138182025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138192025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138202025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
138212025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
138222025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138232025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138242025-01-15T00:58:22.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138252025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
138262025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
138272025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
138282025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
138292025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
138302025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
138312025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
138322025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
138332025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
138342025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
138352025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
138362025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
138372025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
138382025-01-15T00:58:22.609ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138392025-01-15T00:58:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138402025-01-15T00:58:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
138412025-01-15T00:58:22.610ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138422025-01-15T00:58:22.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138432025-01-15T00:58:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
138442025-01-15T00:58:22.611ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138452025-01-15T00:58:22.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138462025-01-15T00:58:22.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138472025-01-15T00:58:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
138482025-01-15T00:58:22.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138492025-01-15T00:58:22.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138502025-01-15T00:58:22.615ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138512025-01-15T00:58:22.617ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138522025-01-15T00:58:22.617ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
138532025-01-15T00:58:22.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
138542025-01-15T00:58:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
138552025-01-15T00:58:22.618ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138562025-01-15T00:58:22.618ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
138572025-01-15T00:58:22.618ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138582025-01-15T00:58:22.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138592025-01-15T00:58:22.619ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
138602025-01-15T00:58:22.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138612025-01-15T00:58:22.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138622025-01-15T00:58:22.622ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138632025-01-15T00:58:22.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138642025-01-15T00:58:22.623ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138652025-01-15T00:58:22.623ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
138662025-01-15T00:58:22.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138672025-01-15T00:58:22.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
138682025-01-15T00:58:22.625ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138692025-01-15T00:58:22.625ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138702025-01-15T00:58:22.625ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
138712025-01-15T00:58:22.625ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1722, tv_nsec: 955266645 } })
138722025-01-15T00:58:22.625ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138732025-01-15T00:58:22.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138742025-01-15T00:58:22.625ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1104 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
138752025-01-15T00:58:22.629ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: b3296ae2-2c2f-4772-a417-ad6b04e701ee, lookup_type: ById(b3296ae2-2c2f-4772-a417-ad6b04e701ee) } result = Ok(())
138762025-01-15T00:58:22.629ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138772025-01-15T00:58:22.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138782025-01-15T00:58:22.632ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138792025-01-15T00:58:22.632ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
138802025-01-15T00:58:22.632ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 23.682586ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
138812025-01-15T00:58:22.643ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee original_time_created = 2025-01-15 00:44:42.882587 UTC target_id = b3296ae2-2c2f-4772-a417-ad6b04e701ee time_created = 2025-01-15 00:44:42.882587 UTC
138822025-01-15T00:58:22.643ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 40.744494ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"b3296ae2-2c2f-4772-a417-ad6b04e701ee","time_created":"2025-01-15T00:44:42.882587Z"}
138832025-01-15T00:58:22.645ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138842025-01-15T00:58:22.646ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
138852025-01-15T00:58:22.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
138862025-01-15T00:58:22.647ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138872025-01-15T00:58:22.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138882025-01-15T00:58:22.648ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
138892025-01-15T00:58:22.648ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
138902025-01-15T00:58:22.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
138912025-01-15T00:58:22.650ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138922025-01-15T00:58:22.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138932025-01-15T00:58:22.652ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 42.970557ms iteration = 28 status = {"errors":[],"finish_invoked_ok":[]}
138942025-01-15T00:58:22.653ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
138952025-01-15T00:58:22.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
138962025-01-15T00:58:22.654ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138972025-01-15T00:58:22.656ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138982025-01-15T00:58:22.657ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
138992025-01-15T00:58:22.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139002025-01-15T00:58:22.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139012025-01-15T00:58:22.657ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.535874ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
139022025-01-15T00:58:22.661ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9, lookup_type: ById(71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9) } result = Ok(())
139032025-01-15T00:58:22.661ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139042025-01-15T00:58:22.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139052025-01-15T00:58:22.662ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139062025-01-15T00:58:22.664ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
139072025-01-15T00:58:22.664ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
139082025-01-15T00:58:22.664ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139092025-01-15T00:58:22.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139102025-01-15T00:58:22.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139112025-01-15T00:58:22.666ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 61.034815ms iteration = 28 status = 0
139122025-01-15T00:58:22.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
139132025-01-15T00:58:22.666ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
139142025-01-15T00:58:22.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
139152025-01-15T00:58:22.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
139162025-01-15T00:58:22.667ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
139172025-01-15T00:58:22.667ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
139182025-01-15T00:58:22.667ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77e4ecb9-8a04-436f-b39d-9c9fda354e72", "content-length": "26", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139192025-01-15T00:58:22.667ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
139202025-01-15T00:58:22.668ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 59.469254ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
139212025-01-15T00:58:22.669ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
139222025-01-15T00:58:22.670ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1112 zone_address = fd00:1122:3344:101::2
139232025-01-15T00:58:22.670ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
139242025-01-15T00:58:22.670ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4eed1e2d-26c8-4aa1-8d51-cf9429a8e684", "content-length": "26", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139252025-01-15T00:58:22.670ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1117 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
139262025-01-15T00:58:22.670ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
139272025-01-15T00:58:22.670ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.505692ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
139282025-01-15T00:58:22.671ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
139292025-01-15T00:58:22.691ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
139302025-01-15T00:58:22.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
139312025-01-15T00:58:22.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.926813ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139322025-01-15T00:58:22.695ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 86.943604ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
139332025-01-15T00:58:22.703ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 94.147982ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
139342025-01-15T00:58:22.726ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1112 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 zone_address = fd00:1122:3344:101::2
139352025-01-15T00:58:22.726ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
139362025-01-15T00:58:22.727ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f09d539-84e7-4487-b9dc-fd41bacd67d7", "content-length": "26", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139372025-01-15T00:58:22.727ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1117 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
139382025-01-15T00:58:22.729ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1149 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
139392025-01-15T00:58:22.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139402025-01-15T00:58:22.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139412025-01-15T00:58:22.762ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.055122ms iteration = 31 status = {"physical_disks_added":0}
139422025-01-15T00:58:22.789ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
139432025-01-15T00:58:22.789ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f688ced1-c0bb-4e40-8ded-333e74f47739", "content-length": "2", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139442025-01-15T00:58:22.790ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
139452025-01-15T00:58:22.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
139462025-01-15T00:58:22.872ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 269.581518ms iteration = 28 status = {}
139472025-01-15T00:58:22.875ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
139482025-01-15T00:58:22.875ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
139492025-01-15T00:58:22.875ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ea85635-8d73-47f6-8fcf-7ca3ed09ecdd", "content-length": "372", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139502025-01-15T00:58:22.875ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139512025-01-15T00:58:22.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139522025-01-15T00:58:22.877ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139532025-01-15T00:58:22.878ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 275.282478ms iteration = 28 status = null
139542025-01-15T00:58:22.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
139552025-01-15T00:58:22.879ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
139562025-01-15T00:58:22.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
139572025-01-15T00:58:22.910ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:370
139582025-01-15T00:58:22.910ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 305.142953ms iteration = 28 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
139592025-01-15T00:58:22.918ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139602025-01-15T00:58:22.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139612025-01-15T00:58:22.920ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: a4c3d8a0-d018-4fe5-9777-c54315993001, rack_id: c52fc7fb-8746-40c6-805b-707ae8abbd97, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(30557785-7cc4-48b0-ab6f-0c6b42d890e1) } rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
139622025-01-15T00:58:22.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139632025-01-15T00:58:22.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139642025-01-15T00:58:22.921ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
139652025-01-15T00:58:22.921ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
139662025-01-15T00:58:22.921ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b8559a73-67fb-4598-9a96-e679f8228a88", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139672025-01-15T00:58:22.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139682025-01-15T00:58:22.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139692025-01-15T00:58:22.923ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139702025-01-15T00:58:22.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139712025-01-15T00:58:22.927ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139722025-01-15T00:58:22.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139732025-01-15T00:58:22.930ZINFOnexus (BackgroundTasks): VPC route manager sled 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
139742025-01-15T00:58:22.930ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
139752025-01-15T00:58:22.930ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e2767b8b-02bb-4e26-9882-a11567a1a2ab", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139762025-01-15T00:58:22.931ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
139772025-01-15T00:58:22.932ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 323.723819ms iteration = 29 status = {}
139782025-01-15T00:58:22.932ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d3be993-64a2-4e79-9c79-dd0234a1f477", "content-length": "134", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139792025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
139802025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 30557785-7cc4-48b0-ab6f-0c6b42d890e1
139812025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
139822025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
139832025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139842025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139852025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139862025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139872025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139882025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139892025-01-15T00:58:22.932ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97
139902025-01-15T00:58:22.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139912025-01-15T00:58:22.933ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139922025-01-15T00:58:22.934ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
139932025-01-15T00:58:22.934ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "720da273-51d1-4a99-a157-402003a12b74", "content-length": "2", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139942025-01-15T00:58:22.934ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
139952025-01-15T00:58:22.935ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "10f97697-688c-489f-83ea-465a491e3064", "content-length": "51", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
139962025-01-15T00:58:22.935ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch_location = Switch0
139972025-01-15T00:58:22.935ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
139982025-01-15T00:58:22.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139992025-01-15T00:58:22.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140002025-01-15T00:58:22.985ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140012025-01-15T00:58:22.987ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
140022025-01-15T00:58:22.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140032025-01-15T00:58:22.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140042025-01-15T00:58:23.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140052025-01-15T00:58:23.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
140062025-01-15T00:58:23.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140072025-01-15T00:58:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140082025-01-15T00:58:23.032ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6166b2b2-ee0e-4f8a-b11e-e407a00b741b", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
140092025-01-15T00:58:23.033ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 switch = Switch0
140102025-01-15T00:58:23.033ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
140112025-01-15T00:58:23.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = c52fc7fb-8746-40c6-805b-707ae8abbd97 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec790f97-2475-40cb-96a8-4e2693906b18", "content-length": "682", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
140122025-01-15T00:58:23.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140132025-01-15T00:58:23.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140142025-01-15T00:58:23.037ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140152025-01-15T00:58:23.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140162025-01-15T00:58:23.041ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140172025-01-15T00:58:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140182025-01-15T00:58:23.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140192025-01-15T00:58:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140202025-01-15T00:58:23.050ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 445.858881ms iteration = 28 status = {}
140212025-01-15T00:58:23.104ZDEBGnexus (BackgroundTasks): client request SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
140222025-01-15T00:58:23.105ZDEBGnexus (BackgroundTasks): client response SledAgent = 71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "818ee093-0ed2-4947-a3d8-2fafd2896c77", "content-length": "691", "date": "Wed, 15 Jan 2025 00:58:22 GMT"} })
140232025-01-15T00:58:23.105ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
140242025-01-15T00:58:23.105ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
140252025-01-15T00:58:23.105ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
140262025-01-15T00:58:23.105ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 497.551935ms iteration = 29 status = {}
140272025-01-15T00:58:23.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a8defbc1-8d5b-4e1a-83de-16f690653eba roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
140282025-01-15T00:58:23.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a8defbc1-8d5b-4e1a-83de-16f690653eba resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
140292025-01-15T00:58:23.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2764 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = a8defbc1-8d5b-4e1a-83de-16f690653eba response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
140302025-01-15T00:58:23.490ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
140312025-01-15T00:58:23.490ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::a]:12221
140322025-01-15T00:58:23.520ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::a]:12221/metrics/producers
140332025-01-15T00:58:23.520ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::a]:12221 remote_addr = [fd00:1122:3344:101::a]:50483
140342025-01-15T00:58:23.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50483 req_id = 111ccd6a-b9b5-499f-8d8e-8ffa3ab15531 roles = RoleSet { roles: {} } uri = /metrics/producers
140352025-01-15T00:58:23.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50483 req_id = 111ccd6a-b9b5-499f-8d8e-8ffa3ab15531 resource = Database result = Ok(()) uri = /metrics/producers
140362025-01-15T00:58:23.567ZINFOnexus: assigned collector to new producer collector_id = dee7453b-558a-4d94-b6a0-8b27cb27f002 file = nexus/src/app/oximeter.rs:76 producer_id = 37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
140372025-01-15T00:58:23.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46999 local_addr = [fd00:1122:3344:101::a]:12221 method = POST remote_addr = [fd00:1122:3344:101::a]:50483 req_id = 111ccd6a-b9b5-499f-8d8e-8ffa3ab15531 response_code = 201 uri = /metrics/producers
140382025-01-15T00:58:23.567ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::a]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "111ccd6a-b9b5-499f-8d8e-8ffa3ab15531", "content-length": "41", "date": "Wed, 15 Jan 2025 00:58:23 GMT"} })
140392025-01-15T00:58:23.568ZDEBGnexus (producer-registration-task): registered with nexus successfully
140402025-01-15T00:58:23.568ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
140412025-01-15T00:58:24.291ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 678 local_addr = [fd00:1122:3344:101::a]:51350 method = GET remote_addr = [fd00:1122:3344:101::d]:42560 req_id = b3fe0940-9f53-418d-88a0-9414054db575 response_code = 200 uri = /37b1f7d9-9bc5-4458-bbbb-17f9bd0e2f85
140422025-01-15T00:58:24.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6872164-3c7b-4c88-8839-7b316185f252 roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
140432025-01-15T00:58:24.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6872164-3c7b-4c88-8839-7b316185f252 resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
140442025-01-15T00:58:24.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2975 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = e6872164-3c7b-4c88-8839-7b316185f252 response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
140452025-01-15T00:58:25.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b090cdb2-b851-4ccb-bddd-854eea250caf roles = RoleSet { roles: {} } uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
140462025-01-15T00:58:25.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b090cdb2-b851-4ccb-bddd-854eea250caf resource = Database result = Ok(()) uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9
140472025-01-15T00:58:25.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2284 local_addr = [fd00:1122:3344:101::a]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:33651 req_id = b090cdb2-b851-4ccb-bddd-854eea250caf response_code = 200 uri = /probes/71cbc9c5-ede9-4cdd-b02d-9d4e4578bbe9